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PREFACE 



Regardless of the branch of science or engineering, theoreticians have always 
been enamored with the notion of expressing their results in the form of 
closed-form expressions. Quite often, the elegance of the closed-form solution 
is overshadowed by the complexity of its form and the difficulty in evaluating 
it numerically. In such instances, one becomes motivated to search instead for 
a solution that is simple in form and simple to evaluate. A further motivation 
is that the method used to derive these alternative simple forms should also be 
applicable in situations where closed-form solutions are ordinarily unobtainable. 
The search for and ability to find such a unified approach for problems dealing 
with evaluation of the performance of digital communication over generalized 
fading channels is what provided the impetus to write this book, the result of 
which represents the backbone for the material contained within its pages. 

For at least four decades, researchers have studied problems of this type, and 
system engineers have used the theoretical and numerical results reported in the 
literature to guide the design of their systems. Whereas the results from the earlier 
years dealt mainly with simple channel models (e.g., Rayleigh or Rician multipath 
fading), applications in more recent years have become increasingly sophisticated, 
thereby requiring more complex models and improved diversity techniques. 
Along with the complexity of the channel model comes the complexity of the 
analytical solution that enables one to assess performance. With the mathematical 
tools that were available previously, the solutions to such problems, when 
possible, had to be expressed in complicated mathematical form which provided 
little insight into the dependence of the performance on the system parameters. 
Surprisingly enough, not until recently had anyone demonstrated a unified 
approach that not only allows previously obtained complicated results to be 
simplified both analytically and computationally but also permits new results 
to be obtained for special cases that heretofore had resisted solution in a simple 
form. This approach, which the authors first presented to the public in a tutorial- 
style article that appeared in the September 1998 issue of the IEEE Proceedings, 
has spawned a new wave of publications on the subject that, we foresee based 
on the variety of applications to which it has already been applied, will continue 
well into the new millennium. The key to the success of the approach relies 
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on employing alternative representations of classic functions arising in the error 
probability analysis of digital communication systems (e.g., the Gaussian Q- 
function 1 and the Marcum g-function) in such a manner that the resulting 
expressions for average bit or symbol error rate are in a form that is rarely more 
complicated than a single integral with finite limits and an integrand composed of 
elementary (e.g., exponential and trigonometric) functions. By virtue of replacing 
the conventional forms of the above-mentioned functions by their alternative 
representations, the integrand will contain the moment generating function (MGF) 
of the instantaneous fading signal-to-noise ratio (SNR), and as such, the unified 
approach is referred to as the MGF-based approach. 

In dealing with application of the MGF-based approach, the coverage in 
this book is extremely broad, in that coherent, differentially coherent, partially 
coherent and noncoherent communication systems are all handled, as well as 
a large variety of fading channel models typical of communication links of 
practical interest. Both single- and multichannel reception are discussed, and 
in the case of the latter, a large variety of diversity types are considered. For 
each combination of communication (modulation/detection) type, channel fading 
model, and diversity type, the average bit error rate (BER) and/or symbol error 
rate (SER) of the system is obtained and represented by an expression that is in 
a form that can readily be evaluated. 2 All cases considered correspond to real 
practical channels, and in many instances the BER and SER expressions obtained 
can be evaluated numerically on a hand-held calculator. 

In accomplishing the purpose set forth by the discussion above, the book 
focuses on developing a compendium of results that to a large extent are not 
readily available in standard textbooks on digital communications. Although 
some of these results can be found in the myriad of contributions that have 
been reported in the technical journal and conference literature, others are new 
and as yet unpublished. Indeed, aside from the fact that a significant number 
of the reference citations in this book are from 1999 publications, many others 
refer to papers that will appear in print in the new millennium. Whether or 
not published previously, the value of the results found in this book is that 
they are all colocated in a single publication with unified notation and, most 
important, a unified presentation framework that lends itself to simplicity of 
numerical evaluation. In writing this book, our intent was to spend as little space 
as possible duplicating material dealing with basic digital communication theory 
and system performance evaluation, which is well documented in many fine 
textbooks on the subject. Rather, this book serves to advance the material found 
in these books and so is of most value to those desiring to extend their knowledge 



1 The Gaussian (2-function has a one-to-one mapping with the complementary error function erfc x 
[i.e., Q(x) = j erfc(x/\/2 )] commonly found in standard mathematical tabulations. In much of the 
engineering literature, however, the two functions are used interchangeably and as a matter of 
convenience we shall do the same in this text. 

2 The terms bit error probability (BEP) and symbol error probability (SEP) are quite often used as 
alternatives to bit error rate (BER) and symbol error rate (SER). With no loss in generality, we shall 
employ both usages in this book. 
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beyond what ordinarily might be covered in the classroom. In this regard, the 
book should have a strong appeal to graduate students doing research in the 
field of digital communications over fading channels as well as to practicing 
engineers who are responsible for the design and performance evaluation of 
such systems. With regard to the latter, the book contains copious numerical 
evaluations that are illustrated in the form of parametric performance curves 
(e.g., average error probability versus average SNR). The applications chosen 
for the numerical illustrations correspond to real practical channels, therefore 
the performance curves provided will have far more than academic value. The 
availability of such a large collection of system performance curves in a single 
compilation allows the researcher or system designer to perform trade-off studies 
among the various communication type/fading channel/diversity combinations so 
as to determine the optimum choice in the face of his or her available constraints. 

The book is composed of four parts, each with an express purpose. The 
first part contains an introduction to the subject of communication system 
performance evaluation followed by discussions of the various types of fading 
channel models and modulation/detection schemes that together form the overall 
system. Part 2 starts by introducing the alternative forms of the classic functions 
mentioned above and then proceeds to show how these forms can be used 
to (1) evaluate certain integrals characteristic of communication system error 
probability performance, and (2) find new representations for certain probability 
density and distribution functions typical of correlated fading applications. 
Part 3 is the “heart and soul” of the book, since in keeping with its title, the 
primary focus of this part is on performance evaluation of the various types of 
fading channel models and modulation/detection schemes introduced in Part 1 
for both single- and multichannel (diversity) reception. Before presenting this 
comprehensive performance evaluation study, however, Part 3 begins by deriving 
the optimum receiver structures corresponding to a variety of combinations 
concerning the knowledge or lack thereof of the fading parameters (i.e., 
amplitude, phase, delay). Several of these structures might be deemed as too 
complex to implement in practice; nevertheless, their performances serve as 
benchmarks against which many suboptimum but practical structures discussed 
in the ensuing chapters might be compared. In Part 4, which deals with practical 
applications, we consider first the problem of optimum combining (diversity) in 
the presence of co-channel interference and then apply the unified approach to 
studying the performance of single- and multiple-carrier direct-sequence code- 
division multiple-access (DS-CDMA) systems typical of the current digital 
cellular wireless standard. Finally, in Part 5 we extend the theory developed in the 
preceding parts for uncoded communication to error-correction-coded systems. 

In summary, the authors know of no other textbook currently on the market 
that addresses the subject of digital communication over fading channels in as 
comprehensive and unified a manner as is done herein. In fact, prior to the 
publication of this book, to the authors’ best knowledge, there existed only two 
works (the textbook by Kennedy [1] and the reprint book by Brayer [2]) that like 
our book are totally dedicated to this subject, and both of them are more than a 
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quarter of a century old. Although a number of other textbooks [3-11] devote 
part of their contents 3 to fading channel performance evaluation, by comparison 
with our book the treatment is brief and therefore incomplete. In view of the 
above, we believe that our book is unique in the field. 

By way of acknowledgment, we wish to thank Dr. Payman Arabshahi of the 
Jet Propulsion Laboratory, Pasadena, CA for providing his expertise in solving 
a variey of problems that arose during the preparation of the electronic version 
of the manuscript. Mohamed-Slim Alouini would also like to express his sincere 
acknowledgment and gratitude to his PhD advisor Prof. Andrea J. Goldsmith 
of Stanford University, Palo Alto, CA for her guidance, support, and constant 
encouragement. Some of the material presented in Chapters 9 and 1 1 is the result 
of joint work with Prof. Goldsmith. Mohamed-Slim Alouini would also like to 
thank Young-Chai Ko and Yan Xin of the University of Minnesota, Minneapolis, 
MN for their significant contributions in some of the results presented in Chapters 
9 and 7, respectively. 



Marvin K. Simon 
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Pasadena, California 
University of Minnesota 
Minneapolis, Minnesota 



REFERENCES 



1. R. S. Kennedy, Fading Dispersive Communication Channels. New York: Wiley- 
Interscience, 1969. 

2. K. Brayer, ed., Data Communications via Fading Channels. Piscataway, NJ: IEEE 
Press, 1975. 

3. M. Schwartz, W. R. Bennett, and S. Stein, Communication Systems and Techniques. 
New York: McGraw-Hill, 1966. 

4. W. C. Y. Lee, Mobile Communications Engineering. New York: McGraw-Hill, 1982. 

5. J. Proakis, Digital Communications. New York: McGraw-Hill, 3rd ed., 1995 (1st and 
2nd eds. in 1983, 1989, respectively). 

6. M. D. Yacoub, Foundations of Mobile Radio Engineering. Boca Raton, FL: CRC 
Press, 1993. 

7. W. C. Jakes, Microwave Mobile Communication, 2nd ed., Piscataway, NJ: IEEE 
Press, 1994. 



3 Although Reference 1 1 is a book that is entirely devoted to digital communication over fading 
channels, the focus is on error-correction coded modulations and therefore would primarily relate 
only to Chapter 12 of our book. 




8. K. Pahlavan and A. H. Levesque, Wireless Information Networks. Wiley Series in 
Telecommunications and Signal Processing. New York: Wiley-Interscience, 1995. 

9. G. L. Stiiber, Principles of Mobile Communication. Norwell, MA: Kluwer Academic 
Publishers, 1996. 

10. T. S. Rappaport, Wireless Communications: Principles and Practice. Upper Saddle 
River, NJ: Prentice Hall, 1996. 

11. S. H. Jamali and T. Le-Ngoc, Coded-Modulation Techniques for Fading Channels. 
Norwell, MA: Kluwer Academic Publishers, 1994. 




Digital Communication over Fading Channels: A Unified Approach to Performance Analysis 
Marvin K. Simon, Mohamed-Slim Alouini 
Copyright © 2000 John Wiley & Sons, Inc. 
Print ISBN 0-471-31779-9 Electronic ISBN 0-471-20069-7 



Part 1 



FUNDAMENTALS 





Digital Communication over Fading Channels: A Unified Approach to Performance Analysis 
Marvin K. Simon, Mohamed-Slim Alouini 
Copyright © 2000 John Wiley & Sons, Inc. 
Print ISBN 0-471-31779-9 Electronic ISBN 0-471-20069-7 



1 



INTRODUCTION 



As we step forward into the new millennium with wireless technologies leading 
the way in which we communicate, it becomes increasingly clear that the 
dominant consideration in the design of systems employing such technologies 
will be their ability to perform with adequate margin over a channel perturbed 
by a host of impairments not the least of which is multipath fading. This is not 
to imply that multipath fading channels are something new to be reckoned with, 
indeed they have plagued many a system designer for well over 40 years, but 
rather, to serve as a motivation for their ever-increasing significance in the years 
to come. At the same time, we do not in any way wish to diminish the importance 
of the fading channel scenarios that occurred well prior to the wireless revolution, 
since indeed many of them still exist and will continue to exist in the future. In 
fact, it is safe to say that whatever means are developed for dealing with the 
more sophisticated wireless application will no doubt also be useful for dealing 
with the less complicated fading environments of the past. 

With the above in mind, what better opportunity is there than now to 
write a comprehensive book that provides simple and intuitive solutions to 
problems dealing with communication system performance evaluation over fading 
channels? Indeed, as mentioned in the preface, the primary goal of this book 
is to present a unified method for arriving at a set of tools that will allow 
the system designer to compute the performance of a host of different digital 
communication systems characterized by a variety of modulation/detection types 
and fading channel models. By set of tools we mean a compendium of analytical 
results that not only allow easy, yet accurate performance evaluation but at the 
same time provide insight into the manner in which this performance depends 
on the key system parameters. To emphasize what was stated above, the set of 
tools developed in this book are useful not only for the wireless applications 
that are rapidly filling our current technical journals but also to a host of others, 
involving satellite, terrestrial, and maritime communications. 

Our repetitive use of the word performance thus far brings us to the purpose 
of this introductory chapter: to provide several measures of performance related 
to practical communication system design and to begin exploring the analytical 

3 
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methods by which they may be evaluated. While the deeper meaning of these 
measures will be truly understood only after their more formal definitions are 
presented in the chapters that follow, the introduction of these terms here serves to 
illustrate the various possibilities that exist, depending on both need and relative 
ease of evaluation. 



1.1 SYSTEM PERFORMANCE MEASURES 



1.1.1 Average Signal-to-Noise Ratio 

Probably the most common and best understood performance measure charac- 
teristic of a digital communication system is signal-to-noise ratio (SNR). Most 
often this is measured at the output of the receiver and is thus related directly to 
the data detection process itself. Of the several possible performance measures 
that exist, it is typically the easiest to evaluate and most often serves as an excel- 
lent indicator of the overall fidelity of the system. Although traditionally, the 
term noise in signal-to-noise ratio refers to the ever-present thermal noise at the 
input to the receiver, in the context of a communication system subject to fading 
impairment, the more appropriate performance measure is average SNR, where 
the word average refers to statistical averaging over the probability distribution 
of the fading. In simple mathematical terms, if y denotes the instantaneous SNR 
[a random variable (RV)] at the receiver output, which includes the effect of 
fading, then 

y= [ YPy(r)dy (l.i) 

Jo 

is the average SNR, where p Y (y) denotes the probability density function (PDF) 
of y. To begin to get a feel for what we will shortly describe as a unified 
approach to performance evaluation, we first rewrite (1.1) in terms of the moment 
generating function (MGF) associated with y, namely, 

m y (s)= r P Ay^dy ( 1 . 2 ) 

Jo 



Taking the first derivative of (1.2) with respect to s and evaluating the result at 
s = 0, we see immediately from (1.1) that 



dM Y (s ) 
F= — 



(1.3) 



That is, the ability to evaluate the MGF of the instantaneous SNR (perhaps 
in closed form) allows immediate evaluation of the average SNR via a simple 
mathematical operation: differentiation. 

To gain further insight into the power of the foregoing statement, we note 
that in many systems, particularly those dealing with a form of diversity 
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(multichannel) reception known as maximal-ratio combining (MRC) (discussed 
in great detail in Chapter 9), the output SNR, y, is expressed as a sum 
(combination) of the individual branch (channel) SNRs (i.e., y = Ym= i Yu 
where L denotes the number of channels combined). In addition, it is often 
reasonable in practice to assume that the channels are independent of each 
other (i.e., the RVs y/|f =1 are themselves independent). In such instances, the 
MGF M y {s) can be expressed as the product of the MGFs associated with 
each channel [i.e., M y (s) = 11/= i M yi (,s)J, which for a large variety of fading 
channel statistical models can be computed in closed form. 1 By contrast, even 
with the assumption of channel independence, computation of the probability 
density function (PDF) p Y (y), which requires convolution of the various PDFs 
PyiiYi) lf=i that characterize the L channels, can still be a monumental task. Even 
in the case where these individual channel PDFs are of the same functional 
form but are characterized by different average SNR’s, y t , the evaluation of 
p y (y) can still be quite tedious. Such is the power of the MGF-based approach; 
namely, it circumvents the need for finding the first-order PDF of the output SNR 
provided that one is interested in a performance measure that can be expressed 
in terms of the MGF. Of course, for the case of average SNR, the solution 
is extremely simple, namely, y = Ym=iYu regardless of whether the channels 
are independent or not, and in fact, one never needs to find the MGF at all. 
However, for other performance measures and also the average SNR of other 
combining statistics [e.g., the sum of an ordered set of random variables typical 
of generalized selection combining (GSC) (discussed in Chapter 9)], matters are 
not quite this simple and the points made above for justifying an MGF-based 
approach are, as we shall see, especially significant. 

1.1.2 Outage Probability 

Another standard performance criterion characteristic of diversity systems oper- 
ating over fading channels is the outage probability denoted by P out and defined as 
the probability that the instantaneous error probability exceeds a specified value 
or equivalently, the probability that the output SNR, y, falls below a certain 
specified threshold, Mathematically speaking, 

Pout= r Py(Y)dy (1.4) 

Jo 

which is the cumulative distribution function (CDF) of y, namely, P Y (y), 
evaluated at y = y^. Since the PDF and the CDF are related by p Y (y) = 

1 Note that the existence of the product form for the MGF M y (s) does not necessarily imply that the 
channels are identically distributed [i.e., each MGF M n f.s) is allowed to maintain its own identity 
independent of the others]. Furthermore, even if the channels are not assumed to be independent, 
the relation in (1.3) is nevertheless valid, and in many instances the MGF of the (combined) output 
can still be obtained in closed form. 
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dP y (y)/dy, and since P Y ( 0) = 0, the Laplace transforms of these two functions 
are related by 2 



Py(s) = 



Py(0 



(1.5) 



Furthermore, since the MGF is just the Laplace transform of the PDF with 
argument reversed in sign [i.e., p Y (s) = M Y (—s)], the outage probability can 
be found from the inverse Laplace transform of the ratio M y (—s)/s evaluated at 
y = Mi, that is, 



_ _L r +jo ° M y ( ~ s K * 

out 2 nj J a - joo s 



(1.6) 



where a is chosen in the region of convergence of the integral in the complex 
s plane. Methods for evaluating inverse Laplace transforms have received 
widespread attention in the literature. (A good summary of these can be found 
in Ref. 1.) One such numerical technique that is particularly useful for CDFs 
of positive RVs (such as instantaneous SNR) is discussed in Appendix 9B and 
applied in Chapter 9. For our purpose here, it is sufficient to recognize once 
again that the evaluation of outage probability can be performed based entirely 
on knowledge of the MGF of the output SNR without ever having to compute 
its PDF. 



1.1.3 Average Bit Error Probability 

The third performance criterion and undoubtedly the most difficult of the three 
to compute is average bit error probability (BEP). 3 On the other hand, it is the 
one that is most revealing about the nature of the system behavior and the one 
most often illustrated in documents containing system performance evaluations; 
thus, it is of primary interest to have a method for its evaluation that reduces the 
degree of difficulty as much as possible. 

The primary reason for the difficulty in evaluating average BEP lies in the 
fact that the conditional (on the fading) BEP is, in general, a nonlinear function 
of the instantaneous SNR, the nature of the nonlinearity being a function of 
the modulation/detection scheme employed by the system. For example, in the 
multichannel case, the average of the conditional BEP over the fading statistics 
is not a simple average of the per channel performance measure as was true 
for average SNR. Nevertheless, we shall see momentarily that an MGF-based 
approach is still quite useful in simplifying the analysis and in a large variety of 
cases allows unification under a common framework. 

2 The symbol “a” above a function denotes its Laplace transform. 

3 The discussion that follows applies, in principle, equally well to average symbol error probability 
(SEP). The specific differences between the two are explored in detail in the chapters dealing with 
system performance. Furthermore, the terms bit error rate (BER) and symbol error rate (SER) are 
often used in the literature as alternatives to BEP and SEP. Rather than choose a preference, in this 
book we use these terms interchangeably. 
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Suppose first that the conditional BEP is of the form 

Pb(E\y) = Ci exp(— «!]/) (1.7) 



such as would be the case for differentially coherent detection of phase-shift- 
keying (PSK) or noncoherent detection of orthogonal frequency- shift-keying 
(FSK) (see Chapter 8). Then the average BEP can be written as 



Pb(E) I 



r 

r 



P b (E\y)p Y (y)dy 



Ci exp(-a l y)p Y (y)dy = CiM y (-ai) 



( 1 . 8 ) 



where again M y (s) is the MGF of the instantaneous fading SNR and depends 
only on the fading channel model assumed. 

Suppose next that the nonlinear functional relationship between P b (E\y) and y 
is such that it can be expressed as an integral whose integrand has an exponential 
dependence on y in the form of (1.7), that is, 4 



r?2 

P b (E\y)= / C 2 h(^exp[-a 2 g^)y]d^ (1.9) 

where for our purpose here h(C) and g(£) are arbitrary functions of the integration 
variable, and typically both and §2 are finite (although this is not an 
absolute requirement for what follows). 5 Although not at all obvious at this 
point, suffice it to say that a relationship of the form in (1.9) can result from 
employing alternative forms of such classic nonlinear functions as the Gaussian 
^-function and Marcum 2-function (see Chapter 4), which are characteristic of 
the relationship between P b {E\y) and y corresponding to, for example, coherent 
detection of PSK and differentially coherent detection of quadriphase-shift-keying 
(QPSK), respectively. Still another possibility is that the nonlinear functional 
relationship between P b (E\y) and y is inherently in the form of (1.9); that is, 
no alternative representation need be employed. An example of such occurs 
for the conditional symbol error probability (SEP) associated with coherent 
and differentially coherent detection of M- ary PSK (M-PSK) (see Chapter 8). 
Regardless of the particular case at hand, once again averaging (1.9) over the 
fading gives (after interchanging the order of integration) 

P b (E)= I" Pb(E\y)p Y (y)dy= f° C 2 h^)exp[-a 2 g(^y]d^p y (y) dy 
Jo Jo J$ 1 



4 In the more general case, the conditional BEP might be expressed as a sum of integrals of the type 
in (1.9). 

5 In principle, (1.9) includes (1.7) as a special case if h(g) is allowed to assume the form of a Dirac 
delta function located within the interval < £ < £2- 
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= C 2 ^ h ^f 0 ex p[-a 2 g©y] Py(y) dy 

= C 2 / * hGWyl-aigmdS (1.10) 

Jh 



As we shall see later in the book, integrals of the form in (1.10) can, for many 
special cases, be obtained in closed form. At the very worst, with rare exceptions, 
the resulting expression will be a single integral with finite limits and an integrand 
composed of elementary functions. 6 Since (1.8) and (1.10) cover a wide variety 
of different modulation/detection types and fading channel models, we refer to 
this approach for evaluating average error probability as the unified MGF -based 
approach and the associated forms of the conditional error probability as the 
desired forms. The first notion of such a unified approach was discussed in Ref. 2 
and laid the groundwork for much of the material that follows in this book. 

It goes without saying that not every fading channel communication problem 
fits the foregoing description; thus, alternative, but still simple and accurate tech- 
niques are desirable for evaluating system error probability in such circumstances. 
One class of problems for which a different form of MGF-based approach is 
possible relates to communication with symmetric binary modulations wherein 
the decision mechanism constitutes a comparison of a decision variable with a 
zero threshold. Aside from the obvious uncoded applications, the class above 
also includes the evaluation of pairwise error probability in error-correction- 
coded systems, as discussed in Chapter 12. In mathematical terms, letting D\y 
denote the decision variable, 7 the corresponding conditional BEP is of the form 
(assuming arbitrarily that a positive data bit was transmitted) 



Pb(E\y) = Pr{D\y < 0} = J° p D]y (D)dD = P Dly (0) (1.11) 



where Pd\y(D) and P D \ y (D) are, respectively, the PDF and CDF of this variable. 
Aside from the fact that the decision variable D\y can, in general, take on 
both positive and negative values whereas the instantaneous fading SNR, y, 
is restricted to positive values, there is a strong resemblance between the binary 
probability of error in (1.11) and the outage probability in (1.4). Thus, by analogy 
with (1.6), the conditional BEP of (1.11) can be expressed as 



P b (E\y) 



j_ r +j °° m dw {-s) 

2nj .L- joc s 



ds 



( 1 . 12 ) 



6 As we shall see in Chapter 4, the h($) and g(£) that result from the alternative representations of 
the Gaussian and Marcum Q-functions are composed of simple trigonometric functions. 

7 The notation D\y is not meant to imply that the decision variable explicitly depends on the fading 
SNR. Rather, it is merely intended to indicate the dependence of this variable on the fading statistics 
of the channel. More about this dependence shortly. 
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where Md\ y (— s) now denotes the MGF of the decision variable D\y [i.e., the 
bilateral Laplace transform of po\y(D) with argument reversed]. 

To see how Md\ y (— s) might explicitly depend on y, we now consider the 
subclass of problems where the conditional decision variable D\ y corresponds to a 
quadratic form of independent complex Gaussian RVs (e.g., a sum of the squared 
magnitudes of, say, L independent complex Gaussian RVs, or equivalently, a 
chi-square RV with 2 L degrees of freedom). Such a form occurs for multiple 
(L)-channel reception of binary modulations with differentially coherent or 
noncoherent detection (see Chapter 9). In this instance, the MGF M D \ Y {s) happens 
to be exponential in y and has the generic form 

M DW (s)= f 1 (s)exp[yf 2 (s)] (1.13) 

If, as before, we let y = J2i= l Yh then substituting (1.13) into (1.12) and 
averaging over the fading results in the average BEP: 8 

Pi(E) > p'“ydz£U <U4) 

2 ItJ J„- joo s 



where 



M d {s)= [ M D]Y {s)p Y {y)dy 
Jo 

= Ms) r ox V [yf 2 {s)]p Y {y)dy = Ms)M Y (f 2 (s)) (1.15) 
Jo 

is the unconditional MGF of the decision variable, which also has the product 
form 

L 

M d (s ) = Ms) Y[M Yl (f 2 (s)) (1.16) 

i=i 

Finally, by virtue of the fact that the MGF of the decision variable can be 
expressed in terms of the MGF of the fading variable (SNR) as in (1.15) [or 
(1.16)], then analogous to (1.10), we are once again able to evaluate the average 
BEP based solely on knowledge of the latter MGF. 

It is not immediately obvious how to extend the inverse Laplace transform 
technique discussed in Appendix 9B to CDFs of bilateral RVs; thus other methods 
for performing this inversion are required. A number of these, including contour 
integration using residues, saddle point integration, and numerical integration 
by Gauss-Chebyshev quadrature rules, are discussed in Refs. 3, through 6 and 
covered later in the book. 

8 The approach for computing average BEP as described by (1.13) was also described by Biglieri 
et al. [3] as a unified approach to computing error probabilities over fading channels. 
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Despite the fact that the methods dictated by (1.14) and (1.8) or (1.10) cover a 
wide variety of problems dealing with the performance of digital communication 
systems over fading channels, there are still some situations that don’t lend 
themselves to either of these two unifying methods. An example of this is 
evaluation of the bit error probability performance of an M- ary noncoherent 
orthogonal system operating over an L-path diversity channel (see Chapter 9). 
However, even in this case there exists an MGF-based approach that greatly 
simplifies the problem and allows for a more general result [7] than that reported 
by Weng and Leung [8], We now outline the method, briefly leaving the more 
detailed treatment to Chapter 9. 

Consider an M- ary communication system where rather than comparing a 
single decision variable with a threshold, one decision variable U\ \y is compared 
with the remaining M — 1 decision variables U m , m = 2, 3, . . . , M, all of which 
do not depend on the fading statistics. 9 Specifically, a correct symbol decision is 
made if U\ \y is greater than U m , m = 2, 3, . . . , M. Assuming that the M decision 
variables are independent, then in mathematical terms, the probability of correct 
decision is given by 

P s (C\y,ui) = Pr [U 2 < mi, t/ 3 < uu ..., U M < ui\U r \y = m} 

= [Pr{ U 2 < u\ \U i [Jf = m}]^ 1 = [[“' P u 2 (u 2 )du 2 ^ 

= ■[1 -(1 -PuM))] M ~ ] (1-17) 

Using the binomial expansion in (1.17), the conditional probability of error 
P s (E\y;u\) = 1 — P s (C\y,u\) can be written as 

P s {E\y-u l )=Y J ( M r ! ) (- ] y + '\- ] - p uM)y=gM (1.18) 



Averaging over u\ and using the Fourier transform relationship between the PDF 
PUi\y(ui) and the MGF Mu^jw), we obtain 



P s (E\y ) = J g{u\)p Vl \ v (u\ ) du.\ 

= Jo Jn / M u l \yU^)e~ ]a>Ul g{ui)do)du l (1.19) 



Again noting that for a noncentral chi-square RV (as is the case for U\\y) the 
conditional MGF Mu^yijco) is of the form in (1.13), then averaging (1.19) over y 



9 Again the conditional notation on y for U\ is not meant to imply that this decision variable is 
explicitly a function of the fading SNR but rather, to indicate its dependence on the fading statistics. 
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transforms M u^ Y (jo)) into M u, (jco) of the form in (1.15), which when substituted 
in (1.19) and reversing the order of integration produces 

p m = ^J°° [jf° e^ u 'g( Ul )du^ dco (1.20) 

Finally, because the CDF Pu 2 (u\) in (1.18) is that of a central chi-square RV 
with 2 L degrees of freedom, the resulting form of g(u\ ) is such that the integral 
on u\ in (1.20) can be obtained in closed form. Thus, as promised, what remains 
again is an expression for average SEP (which for M - ary orthogonal signaling 
can be related to average BEP by a simple scale factor) whose dependence on 
the fading statistics is solely through the MGF of the fading SNR. 

All of the techniques considered thus far for evaluating average error 
probability performance rely on the ability to evaluate the MGF of the 
instantaneous fading SNR y. In dealing with a form of diversity reception referred 
to as equal-gain combining ( EGC ) (discussed in great detail in Chapter 9), 
the instantaneous fading SNR at the output of the combiner takes the form 
y = .l/VTlEti -Jyi) 1 ■ 1° this case it is more convenient to deal with the MGF 
of the square root of the instantaneous fading SNR 

>=vt=^|:v»=2=|:* 

since if the channels are again assumed independent, then again this MGF takes 
on a product form, namely, M x (s) = nf=i M xi (s/VL). Since the average BER 
can alternatively be computed from 

P b (E) = jy P„(E\x)p x (x)dx (1.21) 

then if, analogous to (1.9), P b (E\x) assumes the form 

rh 

P b {E\x)= / C 2 h($)exp[-a 2 g(i:)x 2 ]d$ (1.22) 



a variation of the procedure in (1.10) is needed to produce an expression for 
P b (E) in terms of the MGF of x. First, applying Parseval’s theorem [9, p. 27] to 
(1.21) and letting G(jco) = J\P b (E\x)} denote the Fourier transform of P b (E\x), 
then independent of the form of P b {E\x), we obtain 

P b (E) =^J G{j(o)M x {jco)d(o 




(1.23) 
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where we have recognized that the imaginary part of the integral must be equal 
to zero since Pb{E ) is real, and that the even part of the integrand is an even 
function of co. Making the change of variables 0 = tan -1 co, (1.23) can be written 
in the form of an integral with finite limits: 



Pb(E) = 



71 

2 

n 



— ~ Re[G ( j tan 0)M x (j tan 6)} dO 
cos 2 6 

-7— — Rejtan 0 G(j tan 0)M x {j tan 0)} dO 



(1.24) 



Now, specifically for the form of Pi,(E\x) in (1.22), G(jco) becomes 



') = r C 2 h(k) r exp [ - a 2 g®x 2 + jcox] dx d$ (1.25) 

! JO 



The inner integral on x can be evaluated in closed form as 



exp [ - a 2 g(%)x 2 + jcox\ dx 



[ (» 2 ~ 

° 1.4 a 2 g(S). 



2 a 2 g& \ 

<i - 26) 



where 1 F \ (a, b; c) is the confluent hypergeometric function of the first kind [10, 
Eq. (9.210)]. Therefore, in general, evaluation of the average BER of (1.24) 
requires a double integration. However, for a number of specific applications 
[i.e., particular forms of the functions h(^) and g(§)], the outer integral on £ can 
also be evaluated in closed form; thus, in these instances, Pb(E) can be obtained 
as a single integral with finite limits and an integrand involving the MGF of 
the fading. Methods of error probability evaluation based on the type of MGF 
approach described above have been considered in the literature [11-13] and are 
presented in detail in Chapter 9. 



1.2 CONCLUSIONS 

Without regard to the specific application or performance measure, we have 
briefly demonstrated in this chapter that for a wide variety of digital communi- 
cation systems covering virtually all known modulation/detection techniques and 
practical fading channel models, there exists an MGF-based approach that simpli- 
fies the evaluation of this performance. In the biggest number of these instances, 
the MGF-based approach is encompassed in a unified framework which allows 
the development of a set of generic tools to replace the case-by-case analyses 
typical of previous contributions in the literature. It is the authors’ hope that 
by the time the reader reaches the end of this book and has experienced the 
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exhaustive set of practical circumstances where these tools are useful, he or she 
will fully appreciate the power behind the MGF-based approach and as such will 
generate for themselves an insight into finding new and exciting applications. 
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FADING CHANNEL 
CHARACTERIZATION 
AND MODELING 



Radio-wave propagation through wireless channels is a complicated phenomenon 
characterized by various effects, such as multipath and shadowing. A precise 
mathematical description of this phenomenon is either unknown or too complex 
for tractable communications systems analyses. However, considerable efforts 
have been devoted to the statistical modeling and characterization of these 
different effects. The result is a range of relatively simple and accurate 
statistical models for fading channels which depend on the particular propagation 
environment and the underlying communication scenario. 

The primary purpose of this chapter is to review briefly the principal 
characteristics and models for fading channels. More detailed treatment of this 
subject can be found in standard textbooks, such as Refs. 1,3. This chapter 
also introduces terminology and notation that are used throughout the book. 
The chapter is organized as follows. A brief qualitative description of the main 
characteristics of fading channels is presented in the next section. Models for 
frequency-flat fading channels, corresponding to narrowband transmission, are 
described in Section 2.2. Models for frequency-selective fading channels that 
characterize fading in wideband channels are described in Section 2.3. 



2.1 MAIN CHARACTERISTICS OF FADING CHANNELS 

2.1 .1 Envelope and Phase Fluctuations 

When a received signal experiences fading during transmission, both its envelope 
and phase fluctuate over time. For coherent modulations, the fading effects on the 
phase can severely degrade performance unless measures are taken to compensate 
for them at the receiver. Most often, analyses of systems employing such 
modulations assume that the phase effects due to fading are perfectly corrected 
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at the receiver, resulting in what is referred to as ideal coherent demodulation. 
For noncoherent modulations, phase information is not needed at the receiver 
and therefore the phase variation due to fading does not affect the performance. 
Hence performance analyses for both ideal coherent and noncoherent modulations 
over fading channels requires only knowledge of the fading envelope statistics 
and is the case most often considered in this book. Furthermore, for slow fading 
(discussed next), wherein the fading is at least constant over the duration of a 
symbol time, the fading envelope random process can be represented by a random 
variable (RV) over the symbol time. 

2.1.2 Slow and Fast Fading 

The distinction between slow and fast fading is important for the mathematical 
modeling of fading channels and for the performance evaluation of communica- 
tion systems operating over these channels. This notion is related to the coherence 
time T c of the channel, which measures the period of time over which the fading 
process is correlated (or equivalently, the period of time after which the correla- 
tion function of two samples of the channel response taken at the same frequency 
but different time instants drops below a certain predetermined threshold). The 
coherence time is also related to the channel Doppler spread fj by 




The fading is said to be slow if the symbol time duration T s is smaller than the 
channel’s coherence time T c ; otherwise, it is considered to be fast. In slow fading 
a particular fade level will affect many successive symbols, which leads to burst 
errors, whereas in fast fading the fading decorrelates from symbol to symbol. In 
the latter case and when the communication receiver decisions are made based 
on an observation of the received signal over two or more symbol times (such 
as differentially coherent or coded communications), it becomes necessary to 
consider the variation of the fading channel from one symbol interval to the 
next. This is done through a range of correlation models that depend essentially 
on the particular propagation environment and the underlying communication 
scenario. These various autocorrelation models and their corresponding power 
spectral density are tabulated in Table 2.1, in which for convenience the variance 
of the fast-fading process is normalized to unity. 

2.1.3 Frequency-Flat and Frequency-Selective Fading 

Frequency selectivity is also an important characteristic of fading channels. If 
all the spectral components of the transmitted signal are affected in a similar 
manner, the fading is said to b e. frequency nonselective or, equivalently, frequency 
flat. This is the case for narrowband systems in which the transmitted signal 
bandwidth is much smaller than the channel’s coherence bandwidth f c . This 
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TABLE 2.1 Correlation and Spectral Properties of Various Types of Fading Processes of 
Practical Interest 



Type of Fading Spectrum 


Fading Autocorrelation, p 


Normalized PSD 


Rectangular 


sin(27r f d T s ) 
2nf d T s 




(2/d)- 1 , \f\<f d 


Gaussian 


exp [-(7zf d T s ) 2 ] 






Land mobile 


Jo(27tfuT s ) 




W 2 (/ 2 -^)]- 1/2 , i f\<f d 


First-order Butterworth 


exp(-2^|f d T s |) 




bK)l 


Second-order Butterworth 


( 7t\f d T s \\ 

exp rvri 




M$>T 




x f C os^Z£ + si, 


n\fdT s \ 


A 




l C0S V2 +s 


V2 


) 


Source: Data from Mason [4]. 

a PSD is the power spectral density, fd the Doppler spread, e 


ind T s the 


symbol time. 



bandwidth measures the frequency range over which the fading process is 
correlated and is defined as the frequency bandwidth over which the correlation 
function of two samples of the channel response taken at the same time but 
at different frequencies falls below a suitable value. In addition, the coherence 
bandwidth is related to the maximum delay spread r max by 

fc-j— (2-2) 

On the other hand, if the spectral components of the transmitted signal are affected 
by different amplitude gains and phase shifts, the fading is said to be frequency 
selective. This applies to wideband systems in which the transmitted bandwidth 
is bigger than the channel’s coherence bandwidth. 



2.2 MODELING OF FLAT FADING CHANNELS 

When fading affects narrowband systems, the received carrier amplitude is 
modulated by the fading amplitude a, where a is a RV with mean-square value 
£2 = a 2 and probability density function (PDF) p a (a), which is dependent on the 
nature of the radio propagation environment. After passing through the fading 
channel, the signal is perturbed at the receiver by additive white Gaussian noise 
(AWGN), which is typically assumed to be statistically independent of the fading 
amplitude a and which is characterized by a one-sided power spectral density 
N o (W/Hz). Equivalently, the received instantaneous signal power is modulated 
by a 2 . Thus we define the instantaneous signal-to-noise power ratio (SNR) per 
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symbol by y = a 2 E s /No and the average SNR per symbol by y = QE s /No, 
where E s is the energy per symbol. 1 In addition, the PDF of y is obtained by 
introducing a change of variables in the expression for the fading PDF p a (a) of 
a, yielding 



Py(Y ) = 



PaW^y/y) 

2 Vyy/& 



(2.3) 



The moment generating function (MGF) M r (s) associated with the fading 
PDF p Y (y) and defined by 



M Y {s) = r Privy Y dy (2.4) 

Jo 

is another important statistical characteristic of fading channels, particularly in 
the context of this book. In addition, the amount of fading (AF), or “fading 
figure,” associated with the fading PDF is defined as 

var(a 2 ) _ E[(a 2 - £!) 2 ] _ E(y 2 ) - ( E[y ]) 2 

(£[« 2 ]) 2 C E[y]) 2 ( j 

with £■[-] denoting statistical average and var(-) denoting variance. This figure 
was introduced by Charash [5, p. 29; 6] as a unified measure of the severity of 
the fading and is typically independent of the average fading power Q. 

We now present the various radio propagation effects involved in fading 
channels, their corresponding PDF’s, MGF’s, AF’s, and their relation to physical 
channels. A summary of these properties is tabulated in Table 2.2. 

2.2.1 Multipath Fading 

Multipath fading is due to the constructive and destructive combination of 
randomly delayed, reflected, scattered, and diffracted signal components. This 
type of fading is relatively fast and is therefore responsible for the short-term 
signal variations. Depending on the nature of the radio propagation environment, 
there are different models describing the statistical behavior of the multipath 
fading envelope. 

2.2. 1.1 Rayleigh Model. The Rayleigh distribution is frequently used to 
model multipath fading with no direct line-of-sight (LOS) path. In this case 
the channel fading amplitude a is distributed according to 

A.(«)-^«p(~). a>0 (2.6) 



1 Our performance evaluation of digital communications over fading channels will generally be a 
function of the average SNR per symbol y. 




TABLE 2.2 Probability Density Function (PDF) and Moment Generating Function (MGF) of the SNR per Symbol yfor Some Common Fading 
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and hence, following (2.3), the instantaneous SNR per symbol of the channel, y, 
is distributed according to an exponential distribution given by 

Py(y) = = exp ^-0 , y > 0 (2.7) 

The MGF corresponding to this fading model is given by 

M y {s) = (1 - sy)-' (2.8) 

In addition, the moments associated with this fading model can be shown to be 
given by 

E[y k ] = T(1 + k)y k (2.9) 

where T(-) is the gamma function. The Rayleigh fading model therefore has 
an AF equal to 1 and typically agrees very well with experimental data for 
mobile systems, where no LOS path exists between the transmitter and receiver 
antennas [3], It also applies to the propagation of reflected and refracted paths 
through the troposphere [7] and ionosphere [8,9] and to ship-to-ship [10] radio 
links. 

2.2.1. 2 Nakagami-q (Hoyt) Model. The Nakagami-g distribution, also 
referred to as the Hoyt distribution [11], is given in Nakagami [12, Eq. (52)] 
by 



Pa(oc) = - 



4q 2 Q 



4q 2 i 2 



where I o(-) is the zeroth-order modified Bessel function of the first kind, and q is 
the Nakagami-g fading parameter which ranges from 0 to 1. Using (2.3), it can 
be shown that the SNR per symbol of the channel, y, is distributed according to 



, , i +<? 2 r (i+^vi , ( 
fv(r) = ^r exp [ — isH'H 



y> 0 (2.11) 



It can be shown that the MGF corresponding to (2.11) is given by 



(1 + <7 2 ) 2 J 

Also, the moments associated with this model are given by [12, Eq. (52)] 



E(y k ) = T(\+k) 2 F l 



*-i _k ( \-r ' 

2 2 v 1 + q 2 y 
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where 2^1 (•. •) is the Gauss hypergeometric function, and the AF of the 

Nakagami-c/ distribution is therefore given by 



AF q 



2(1 +q 4 ) 
(1 + q 2 ) 2 ’ 



0 < q < 1 



(2.14) 



and hence ranges between 1 (q = 1) and 2 (q = 0). The Nakagami-g distribution 
spans the range from one-sided Gaussian fading ( q = 0) to Rayleigh fading 
(q = 1). It is typically observed on satellite links subject to strong ionospheric 
scintillation [13,14], Note that one-sided Gaussian fading corresponds to the 
worst-case fading or, equivalently, the largest AF for all multipath distributions 
considered in our analyses. 



2.2. 1.3 Nakagami-n (Rice) Model. The Nakagami-n distribution is also 
known as the Rice distribution [15]. It is often used to model propagation 
paths consisting of one strong direct LOS component and many random weaker 
components. Here the channel fading amplitude follows the distribution [12, 
Eq. (50)] 



Paid) 



_ 2(1 + n 2 )e~' 



(1 + n 2 )a 2 
£2 



h 




a> 0 



(2.15) 

where n is the Nakagami-n fading parameter which ranges from 0 to 00 and 
which is related to the Rician K factor by K = n 2 . Applying (2.3) shows that 
the SNR per symbol of the channel, y, is distributed according to a noncentral 
chi-square distribution given by 



p Y (y) ■ 



. (1 + n 2 )e- n 



(1 + n 2 )y 1 



It can also be shown that the MGF associated with this fading model 



y > 0 

(2.16) 
given by 



... . (1 + n 2 ) r n 2 sy \ 

and that the moments are given by [12, Eq. (50)] 



(1 + n 2 ) k 



(2.17) 



(2.18) 



where 1 F \ (•, •;•) is the Kummer confluent hypergeometric function. The AF of 
the Nakagami-n distribution is given by 



AF„ 



1 +2n 2 
(1 + n 2 ) 2 ’ 



n > 0 



(2.19) 
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and hence ranges between 0 (n = oo) and 1 (n = 0). The Nakagami-n distribution 
spans the range from Rayleigh fading (n = 0) to no fading (constant amplitude) 
(n = oo). This type of fading is typically observed in the first resolvable 
LOS paths of microcellular urban and suburban land-mobile [16], picocellular 
indoor [17], and factory [18] environments. It also applies to the dominant LOS 
path of satellite [19,20] and ship-to-ship [10] radio links. 

2.2. 1.4 Nakagami-m Model. The Nakagami-m PDF is in essence a central 
chi-square distribution given by [12, Eq. (11)] 

2 m' n a 2m ~ 1 ( ma 2 \ 

p " (a) = TFrSr exp {—) ' “ - 0 (2 ' 20) 

where m is the Nakagami-m fading parameter which ranges from ^ to oo. 
Figure 2.1 shows the Nakagami-m PDF for £2 = 1 and various values of the 
m parameter. Applying (2.3) shows that the SNR per symbol, y, is distributed 
according to a gamma distribution given by 




Channel Fade Amplitude a 

Figure 2.1. Nakagami PDF for £2 = 1 and various values of the fading parameter m. 
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It can also be shown that the MGF is given in this case by 



M Y (s) = 




and that the moments are given by [12, Eq. (65)] 



E[y k ] = 



r (m + k)_ k 

Y(m)m k Y 



which yields an AF of 



AF m 



( 2 . 22 ) 



(2.23) 



(2.24) 



Hence, the Nakagami-m distribution spans via the m parameter the widest range of 
AF (from 0 to 2) among all the multipath distributions considered in this book. For 
instance, it includes the one-sided Gaussian distribution (m = ^) and the Rayleigh 
distribution (m = 1) as special cases. In the limit asm-> +oo, the Nakagami-m 
fading channel converges to a nonfading AWGN channel. Furthermore, when 
m < 1, equating (2.14) and (2.24), we obtain a one-to-one mapping between the 
m parameter and the q parameter, allowing the Nakagami-m distribution to closely 
approximate the Nakagami-g (Hoyt) distribution, and this mapping is given by 



(1+ ^ m < 1 

2(1 + 2q 4 ) 



Similarly, when m > 1, equating (2.19) and (2.24) we obtain another one-to-one 
mapping between the m parameter and the n parameter (or, equivalently, the 
Rician K factor), allowing the Nakagami-m distribution to closely approximate 
the Nakagami-n (Rice) distribution, and this mapping is given by 



_ (1 + n 2 ) 2 

m 1 + 2 n 2 ’ 



n> 0 




m> 1 



(2.26) 



Finally, the Nakagami-m distribution often gives the best fit to land- 
mobile [21-23] and indoor-mobile [24] multipath propagation, as well as 
scintillating ionospheric radio links [9,25-28], 



2.2.2 Log-Normal Shadowing 

In terrestrial and satellite land-mobile systems, the link quality is also affected 
by slow variation of the mean signal level due to the shadowing from 
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terrain, buildings, and trees. Communication system performance will depend 
on shadowing only if the radio receiver is able to average out the fast multipath 
fading or if an efficient microdiversity system is used to eliminate the effects of 
multipath. Based on empirical measurements, there is a general consensus that 
shadowing can be modeled by a log-normal distribution for various outdoor and 
indoor environments [21,29-33], in which case the path SNR per symbol y has 
a PDF given by the standard log-normal expression 



Mr) = 71w“ p|_ 



(iQiogio v-n) 



(2.27) 



where £ = 10/ In 10 = 4.3429, and fi (dB) and a (dB) are the mean and standard 
deviation of 101og 10 y, respectively. 

The MGF associated with this slow-fading effect is given by 



M y (s) ~ J= exp(10 ( ' /5 “" +/i)/K, .s) 

»= 1 



(2.28) 



where x n are the zeros of the A^-order Hermite polynomial, and H Xn are the 
weight factors of the N p - order Flermite polynomial and are given by Table 25.10 
of Ref. 50. In addition, the moments of (2.27) are given by 



£[/] = exp 




yielding an AF of 




(2.29) 



(2.30) 



From (2.30) the AF associated with a log-normal PDF can be arbitrarily high. 
However, as noted by Charash [5, p. 29], in practical situations the standard 
deviation of shadow fading does not exceed 9 dB [3, p. 88]. Hence, the AF of 
log-normal shadowing is bounded by 73. This number exceeds the maximal AF 
exhibited by the various multipath PDFs studied in Section 2.2.1 by several order 
of magnitudes. 



2.2.3 Composite Multipath/Shadowing 

A composite multipath/shadowed fading environment consists of multipath fading 
superimposed on log-normal shadowing. In this environment the receiver does 
not average out the envelope fading due to multipath but rather, reacts to the 
instantaneous composite multipath/shadowed signal [3, Sec. 2.4.2], This is often 
the scenario in congested downtown areas with slow-moving pedestrians and 
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vehicles [21,34,35]. This type of composite fading is also observed in land- 
mobile satellite systems subject to vegetative and/or urban shadowing [36-40]. 
There are two approaches and various combinations suggested in the literature 
for obtaining the composite distribution. Here, as an example, we present the 
composite gamma/log-normal PDF introduced by Ho and Stiiber [35]. This PDF 
arises in Nakagami-m shadowed environments and is obtained by averaging the 
gamma distributed signal power (or, equivalently, the SNR per symbol) of (2.21) 
over the conditional density of the log-normally distributed mean signal power 
(or equivalently, the average SNR per symbol) of (2.27), giving the following 
channel PDF: 



f°° m y ( my\ £ 

PyM = / mr , , exp —== — exp 

Jo H’"‘ T (m) V w ) y/btaw 



(10 log 10 w-/r) 2 ' 
2 a 2 



dw 

(2.31) 



For the special case where the multipath is Rayleigh distributed ( m = 1), (2.31) 
reduces to a composite exponential/log-normal PDF which was initially proposed 
by Hansen and Meno [34]. 

The MGF is given in this case by 



- H Xn (\ - I0 (V 



s/m) ’ 



and the moments associated with a gamma/log-normal PDF are given by 



E[/] = 



T (m + k) 

T w^ exp 





and the resulting AF is given by 



AF mo . = 




- 1 



(2.33) 



(2.34) 



Note that when shadowing is absent (er = 0), (2.34) reduces to (2.24), as expected. 
Similarly, as the fading is reduced ( m -> oo), (2.34) reduces to (2.30), as 
expected. 



2.2.4 Combined (Time-Shared) Shadowed/Unshadowed Fading 

From their land-mobile satellite channel characterization experiments, Lutz 
et al. [39] and Barts and Stutzman [41] found that the overall fading process for 
land-mobile satellite systems is a convex combination of unshadowed multipath 
fading and a composite multipath/shadowed fading. Here, as an example, we 
present in more detail the Lutz et al. model [39]. When no shadowing is present, 
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the fading follows a Rice (Nakagami-n) PDF. On the other hand, when shadowing 
is present, it is assumed that no direct LOS path exists and the received signal 
power (or, equivalently, SNR per bit) is assumed to be an exponential/log- 
normal (Hansen-Meno) PDF [34], The combination is characterized by the 
shadowing time-share factor, which is denoted by A, 0 < A < 1 ; hence, the 
resulting combined PDF is given by 



p y (y) = (l-A) 



(1 + K)e~ K 



r 






r 

(ioiog 10 w — [i s y 



| dw 
(2.35) 



where y u is the average SNR per symbol during the unshadowed fraction of time, 
and /i s and a s are the average and standard deviation of 1 0 log l0 y during the 
shadowed fraction of time, respectively. The overall average SNR per symbol, 
y, is then given by 



y = (1 - A)y U + A • lO^'/IO+On I0)(cr s ) 2 /200 
Finally, the MGF can be shown to be given by 

Ksy u 



l+K-sy “ r L(l+*0-sF"J 

i N - 

+ A-=y^H x (1 - ioN^+^VIO^-i 



2.3 MODELING OF FREQUENCY-SELECTIVE FADING CHANNELS 

When wideband signals propagate through a frequency-selective channel, their 
spectrum is affected by the channel transfer function, resulting in a time 
dispersion of the waveform. This type of fading can be modeled as a linear 
filter characterized by the following complex-valued lowpass equivalent impulse 
response: 

l p 

h(t) = J2a l e-^S(t-r I ) (2.38) 



where <?(•) is the Dirac delta function, l the channel index, and {a/}jZj, {Oi}\L v 
and the random channel amplitudes, phases, and delays, respectively. 
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In (2.38) L p is the number of resolvable paths (the first path being the reference 
path whose delay X\ = 0) and is related to the ratio of the maximum delay 
spread to the symbol time. Under the slow-fading assumption, L p is assumed 
to be constant over a certain period of time, and and {r i}jtx- 

are all constant over a symbol interval. If the various paths of a given impulse 
response are generated by different scatterers, they tend to exhibit negligible 
correlations [33,42] and it is reasonable in that case to assume that the { ai } l L :l 
are statistically independent RV’s. Otherwise, the { a\ } l L :l have to be considered 
as correlated RV’s and various fading correlation models of interest will be 
presented in Section 9.6. 

Extending the flat fading notations, the fading amplitude a; of the /th resolved 
path is assumed to be a RV whose mean-square value aj is denoted by Q/ and 
whose PDF p ai ( a; ) can be any one of the PDFs presented above. Also as in the 
flat fading case, after passing through the fading channel, a wideband signal is 
perturbed by AWGN with a one-sided power spectral density No (W/Hz). The 
AWGN is assumed to be independent of the fading amplitudes {cq}f =1 . Hence 
the instantaneous SNR per symbol of the Zth channel is given by yi = ojE JNq, 
and the average SNR per symbol of the Zth channel is given by y t = Q/EJNq. 

The first arriving path in the impulse response typically exhibits a lower 
amount of fading than subsequent paths, since it may contain the FOS 
path [16,23,42] Furthermore, since the specular power component typically 
decreases with respect to delay, the last arriving paths exhibit higher amounts 
of fading [23,42], The {£2/};=! are related to the channel’s power delay profile 
( PDP ), which is also referred to as the multipath intensity profile ( MIP ) and 
which is typically a decreasing function of the delay. The PDP model can 
assume various forms, depending on whether the model is for indoor or outdoor 
environments and for each environment, the general propagation conditions. 
PDP’s for indoor partitioned office buildings, indoor factory buildings with heavy 
machinery, high-density office buildings in urban areas, low-density residential 
houses in suburban areas, open rural environment, hilly or mountainous regions, 
and maritime environment are described in Ref. 43. For example, experimental 
measurements indicate that the mobile radio channel is well characterized by an 
exponentially decaying PDP for indoor office buildings [33] and congested urban 
areas [29,44]: 

a, = fV _ ' c,/Tma \ l = \,2. ... ,l. p (2.39) 

where f2| is the average fading power corresponding to the first (reference) 
propagation path and r max is the channel maximum delay spread. In the literature 
the delays are often assumed to be equally spaced (t/+i — t/ is constant and equal 
to the symbol time T s ) [1, Sec. 14-5-1; 45], and with this assumption, we get the 
equally spaced exponential profile given by 



Q.I = Q. x e- (l - l) \ 



5 > 0 and 1 = 1,2, ...,L [ 



(2.40) 
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where the parameter S is the power decay factor, which reflects the rate at which 
the average fading power decays. Other idealized PDP profiles reported or used in 
the literature include the constant (flat) [46], the flat exponential [47], the double 
spike [46], the Gaussian [46], the power function (polynomial) [48], and other 
more complicated composite profiles [49], 
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TYPES OF COMMUNICATION 



Digital modulation techniques are typically classified based on (1) the carrier 
attribute (e.g., phase, amplitude, frequency) that is being modulated, (2) the 
number of levels assigned to the modulated attribute, and (3) the degree to which 
the receiver extracts information about the unknown carrier phase in performing 
the data detection function (e.g., coherent, partially coherent, differentially 
coherent, noncoherent). Although most combinations of these classification 
categories are possible, some are more popular than others. In the simplest 
case, only a single carrier attribute is modulated, whereas a more sophisticated 
modulation scheme would allow for modulating more than one attribute (e.g., 
amplitude and phase), the latter affording additional degrees of freedom in 
satsifying the power and bandwidth requirements of the system. 

Our goal in this chapter is to review the most popular digital modulation 
techniques (i.e., those that are most often addressed in the literature) and 
discuss their transmitted signal form as well as their detection over the additive 
white Gaussian noise (AWGN) channel. In all cases we limit our consideration 
to receivers that implement the maximum a posteriori (MAP) decision rale 
[maximum-likelihood (ML) for equiprobable signal hypotheses] and as such 
are optimum from the standpoint of minimizing error probability. Emphasis is 
placed on those modulations that might be used in applications where the channel 
exhibits multipath fading. 



3.1 IDEAL COHERENT DETECTION 

Consider a complex sinusoidal carrier, c,{t) = A c e' (2nfct+ec \ which in the simplest 
case is amplitude, phase, or frequency modulated by an M - level (M = 2 m > 2) 
digital waveform, a(t), 6{t), or fit), respectively, in accordance with the 
digital data to be transmitted over the channel (Fig. 3.1). The corresponding 
bandpass complex transmitted signal then becomes s(t ) = S{t)e' (2n ^ l+e< \ where 
S(t ) is the equivalent baseband complex transmitted signal and takes on the 
specific forms S(t) = A c a(t), S(t) = A c e-' e(l) , and S(t) = A c e lf(l)t , respectively. 
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h(t) 




Figure 3.1 . Generic complex form of transmitter and receiver for ideal coherent detection over 
the AWGN. (The asterisk on the multiplier denotes complex conjugate multiplication.) 



When more than one attribute of the carrier is modulated (e.g., amplitude and 
phase), the transmitted signal would have the form s(t) = A c a(t)e jl2n ^ c>+9c+em \ 
Corresponding to any of the cases above, the total received complex signal 
is r(t) = a c hs(t) + h(t), where hit) is a complex white bandpass Gaussian 
noise process with single-sided power spectral density (PSD) No (W/Hz) [i.e., 
E{h(t)h*(t + r)} = No8(t — r)] and a c h is the attenuation introduced by the 
channel. For the case of a pure AWGN channel as considered here, a C h is a 
deterministic constant and for our purposes can be set equal to unity. For the 
fading channel considered later in the book, a C h is a complex random variable 
whose statistics depend on the particular type of fading (e.g., for a Rayleigh or 
Rician channel, a c h would be a complex Gaussian random variable). 

In the case of ideal phase coherent detection (often called simply coherent 
detection), the receiver reconstructs the carrier with perfect knowledge of 
the phase and frequency. Thus, the receiver forms the signal 1 c r (t) = 
e j( 2 nf c t+o c ) _ an( j uses jjyg to p er f orm a complex conjugate demodula- 
tion of the received signal (Fig. 3.1). The output of this demodulation is then 
x(t) = r(t)c*(t) = S(t) + h(t)c*(t) which depending on the particular form of 
modulation corresponding to the three simple cases above is either x(t) = 
A c a(t ) + h{t)~c*{t), x(t) = A c e^ m + h(t)i*{t), or x(t) = A c e^ m + h(t)~c*{t). 
The optimum receiver then performs matched filtering operations on x(t) during 
each successive transmitted interval corresponding to the M possible transmitted 
information symbols in that interval and proceeds to make a decision based on 
the largest of the resulting M outputs. We now discuss a number of specific 
cases of the foregoing generic signal model along with the characteristics of the 
corresponding ideal coherent receiver. 



1 Again since we are considering here only the pure AWGN channel with idealized demodulation, 
the amplitude of the carrier reference signal is deterministic and may be normalized to unity with 
no loss in generality. Later when considering the fading channel, we shall see that the statistics of 
the fading channel must be taken into account in modeling the demodulation reference signal. 
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3.1 .1 Multiple Amplitude-Shift-Keying or Multiple Amplitude 
Modulation 

A multiple amplitude-shift-keyed (M-ASK) signal [more often referred to as 
multiple amplitude modulation (M-AM)] occurs when a(t) takes on equiprobable 
symmetric 2 values a, = 2i — I — M, i = 1.2,.... M, in each symbol interval T s 
which is related to the bit time Tb by T s = T [, log 2 M. As such, a(t) is modeled 
as a random pulse stream, that is, 



a(t)= a „p(.t-nT s ) 



(3.1) 



where a n is the information (data) amplitude in the nth symbol interval nT s < 
t < (n + 1 )T S ranging over the set of M possible values a, as above, and pit) is a 
unit amplitude rectangular pulse of duration T s seconds. The signal constellation 
(i.e., the locus of points of the baseband complex signal in two dimensions) is a 
straight line along the horizontal axis with points spaced uniformly by two units. 
In the nth symbol interval the transmitted complex signal is 

~s(t) = A e a n e j(2nfct+e ‘ ) (3.2) 

Note that because of the rectangular pulse shape, the complex baseband signal 
S(t) = A c a„ is constant in this same interval. At the receiver, after complex- 
conjugate demodulation by the ideal phase coherent reference c r (t) = e ' {ln fct+ec \ 
we obtain 

x(t)=A c a n +N(t) (3.3) 

where N(t) = h(t)c* (t) is a zero-mean baseband complex Gaussian process. 
Passing x(t) through M matched filters [integrate-and-dump (I&D) circuits for 
the assumed rectangular pulse shape of the modulation] 3 results in the M outputs 
(Fig. 3.2a) 



r(n+ l)T s 

y nk = a k a n A c T s + a k N n , k = 1, 2, . . . , M, N n = N(t ) dt 

(3.4) 

whereupon a decision corresponding to the largest Re{y„G = a k a„A c T s + 
Re{a*A„] is made on the transmitted amplitude. Alternatively, the amplitude 
scaling by the M possible levels a, and maximum selection can be replaced by 
an M- level quantizer acting on the single real decision variable (see Fig. 3.2 b) 

y„ = a n A c T s +N„, N n = Re{A„} (3.5) 

2 In our discussions of AM, we consider only the case wherein the amplitude levels are distributed 
symmetrically around the zero level. For a discussion of asymmetric AM, see Ref. 1. 

3 As is well known, only a single matched filter is required whose output is scaled by the M possible 
values of a;. 
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(a) 



Data 




(b) 

Figure 3.2. Complex forms of optimum receiver for ideal coherent detection of M-AM over the 
AWGN: (a) conventional maximum-likelihood form; (b) simpler decision threshold form. 



3.1.2 Quadrature Amplitude-Shift-Keying or Quadrature Amplitude 
Modulation 

A quadrature amplitude-shift-keyed ( QASK) signal [more commonly referred to 
as quadrature amplitude modulation ( QAM)] is a two-dimensional generalization 
of M-AM which can be viewed as a combined amplitude/phase modulation 
or more conveniently as a complex amplitude-modulated carrier. The signal 
constellation is a rectangular grid with points uniformly spaced along each axis 
by 2 units. Letting M still denote the number of possible transmitted waveforms, 
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then in the nth symbol interval a QAM signal can be expressed as 4 

s(t) = A c {a In + ja Qn (3.6) 

where the information amplitudes a/ n and oq„ range independently over the 
sets of equiprobable values a, = 21 — 1 — ~JM, i = 1,2, ... , Vm, and a; = 
21 — 1 — VM, / = 1,2, ... , y/M, respectively, and the I and Q subscripts denote 
the in-phase and quadrature channels. Here again, because of the assumed 
rectangular pulse shape, the complex baseband signal S(t ) = A c (a/ n + jaQn) is 
constant in this same interval. At the receiver the signal is again first complex- 
conjugate demodulated by c r (t), which results in 



x(t) = A c (a In + ja Qn ) + N(t) 



(3.7) 



Performing matched filter operations on x(t) and recognizing the independence 
of the I and Q channels produces the decision variables (Fig. 3.3a) 



yink = Re{yi} = a k a In A c T s + a k N In , 
N In = Re | f + ) S A(r)dt} 



, VM/2, 



y Qnk = Im{yi} = a k a Qn A c T s + a k N Qn , k = 1, 2, ... , Vm/2, 
Nq„ = Im 



(3.8) 



whereupon separate decisions corresponding to the largest y knk and yQ nk are 
made on the I and Q components of the amplitude transmitted in the zeroth 
signaling (symbol) interval 0 < t < T s . Alternatively, the scaling by the M 
possible amplitude levels and maximum selection for the real and imaginary parts 
of the complex decision variable can be replaced by separate M-level quantizers 
acting on the single pair of I and Q decision variables 

yin = ai n A c T s + N i n 

y e n=a Qn A c T s +N Qn (3.9) 



in which case the complex receiver of Fig. 3.3a can be redrawn in the I-Q form 
of Fig. 33b. 



3.1.3 M-ary Phase-Shift-Keying 

An M-ary phase-shift-keyed (M-PSK) signal occurs when 9(t) takes on equiprob- 
able values = (2 i — l)jt/M, i = 1,2, ... ,M, in each symbol interval T s . As 



4 Again, one can think of the complex carrier as being modulated now by a complex random pulse 
stream, namely, 5(f) = J2™=-oo ( a ln + jaQn)p(t — nT s ). 
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Figure 3.3. Complex forms of optimum receiver for ideal coherent detection of QAM over the 
AWGN: (a) conventional maximum-likelihood form; (b) simpler decision threshold form. 



such, Q(t) is modeled as a random pulse stream, that is, 

9(t)= O n p(t-nT s ) (3.10) 



where 0 n is the information phase in the nth symbol interval nT s < t < (n + I )T S 
ranging over the set of M possible values /S; as above, and p(t) is again a unit 
amplitude rectangular pulse of duration T s seconds. The signal constellation is 
a unit circle with points uniformly spaced by 2n/M radians. Thus, the complex 
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signal transmitted in the nth symbol interval is 

~s(t)=A c e^ t+e ‘ +e " ) 



(3.11) 



Note again that because of the assumed rectangular pulse shape, the complex 
baseband signal S(t) = A c e' e " is constant in this same interval. After demodu- 
lating with the complex conjugate of c r (t ) at the receiver, we obtain 



x(t) = A c e je ” + N(t) (3.12) 

Passing (3.12) through an I&D and then multiplying the output by e~^ k , 
k = 1,2 , ,M, produces the decision variables (Fig. 3.4) 

y nk = A c T s e m ~ h) + e~ ih N n , k = 1,2, ... ,M, 

r(n+l)T s 

Nn = J N(t)dt (3.13) 



from which a decision corresponding to the largest Re{y„i} =A c T s cos(9 n — 
Pk) + Re{e~^ k N„} is made on the information phase transmitted in the nth 
signaling interval. 

A popular special case of M-PSK modulation is binary PSK (BPSK), which 
corresponds to M = 2. Since ideally the detection of M-PSK is independent of 
the location of the points around the unit circle (as long as they remain uniformly 
spaced by 2 n/M radians), we can alternatively take as the possible values for 0 n 
the set Pi = 2in/M, i = 0, 1, 2, . . . , M — 1, which for M = 2 become Pi = 0, : r. 
Since e'° = 1 and e' n = — 1, the transmitted signal of (3.1 1) can be written in the 
form (3.2), where, in each transmission interval (now a bit interval T b ), a„ takes 
on the pair of equiprobable values ±1. Thus, we observe that BPSK is the same 
as M- AM with M = 2. That is, binary amplitude and binary phase modulation 
are identical and are referred to as antipodal signaling. The receiver for BPSK is 
a special case of Fig. 3.4 which takes on the simpler form illustrated in Fig. 3.5 
wherein the ±1 amplitude scaling and maximum selection are replaced by a 
two-level quantizer (hard limiter) acting on the single real decision variable 

y„ = a n A c T b +N„, N n = Re{A„} (3.14) 

Another special case of M-PSK which because of its throughput efficiency 
(bits/second per unit of bandwidth) is quite popular is QPSK, which corre- 
sponds to M = 4. Here it is conventional to assume the phase set p t = 
n/A, ?>n/A, 5 ji/ 4, lit /A. Projecting these information phases on the quadrature 
amplitude axes, we can equivalently write QPSK in the I-Q form of (3.6), 
where aj n and each take on values ±1. 5 We thus see that QPSK can also be 
looked upon as a special case of QAM with M = 4, and thus the detection of an 



5 The actual projections of the unit circle on the I and Q coordinate axes are l/\/2. However, since 
the carrier amplitude is arbitrary, it is convenient to rescale the carrier amplitude such that the 
equivalent I and Q data amplitudes take on ±1 values. 
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Figure 3.4. Complex form of optimum receiver for ideal coherent detection of /W-PSK over the 
AWGN. 



Data 

Amplitude 




Figure 3.5. Complex form of optimum receiver for ideal coherent detection of BPSK over the 
AWGN. 



information phase can be obtained by combining the detections on the I and Q 
components of this phase. The receiver for QPSK is illustrated in Fig. 3.6 and 
is a two-dimensional version of that for BPSK and a special case of that for 
QAM. The decision variables that are input to the hard-limiting threshold 
devices are 

yin = Re{v„} = ai„A c T s + Ni„, 
y Qn = Im{y„) = a Qn A c T s + N Qn 



Ni„ = Re S N(t)dt^ 

N Qn = Im {OH 



(3.15) 
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Figure 3.6. Complex form of optimum receiver for ideal coherent detection of QPSK over the 
AWGN. 



While for M-PSK with M = 2 m and m arbitrary, one can also project the 
information phases on the I and Q coordinates and thus make decisions on each 
of these multilevel amplitude signals, it should be noted that these decisions 
are not independent, and furthermore each pair of amplitude decisions does not 
necessarily render one of the transmitted phases. That is, the number of possible 
I-Q amplitude pairs obtained from the projections of the M possible transmitted 
phases exceeds M. Thus, for M > 8 it is not practical to view M-PSK in an I-Q 
form. 

3.1.4 Differentially Encoded /W-ary Phase-Shift-Keying 

In an actual coherent communication system transmitting M-PSK modulation, a 
means must be provided at the receiver for establishing the local demodulation 
carrier reference signal. This means is tradionally accomplished with the aid of a 
suppressed carrier tracking loop [1, Chap. 2], Such a loop for M-PSK modulation 
exhibits an M-fold phase ambiguity in that it can lock with equal probability at 
the transmitted carrier phase plus any of the M information phase values. Hence, 
the carrier phase used for demodulation can take on any of these same M phase 
values, namely, 0 C + fa = 6 C + 2 in/M, i = 0, 1, 2, . . . , M — 1. Clearly, coherent 
detection cannot be successful unless this M-fold phase ambiguity is resolved. 

One means for resolving this ambiguity is to employ differential phase 
encoding (most often simply called differential encoding ) at the transmitter 
and differential phase decoding (most often simply called differential decoding ) 
at the receiver following coherent detection. That is, the information phase 
to be communicated is modulated on the carrier as the difference between 
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Figure 3.7. Complex form of optimum receiver for ideal coherent detection of OQPSK over the 
AWGN. 



two adjacent transmitted phases, and the receiver takes the difference of two 
adjacent phase decisions to arrive at the decision on the information phase. 6 
In mathematical terms, if A 0 n was the information phase to be communicated 
in the nth transmission interval, the transmitter would first form Q n = 0 n _\ + 
A 9 n modulo 2jt (the differential encoder) and then modulate 0„ on the carrier. 7 
At the receiver, successive decisions on 6 „- 1 and 6 n would be made and then 
differenced modulo 2n (the differential decoder) to give the decision on A0 n . 
A block diagram of such a differentially encoded M -PSK system is illustrated 
in Fig. 3.7. It should be clear from this diagram that since the decision on the 
true information phase is obtained from the difference of two adjacent phase 
decisions, a performance penalty is associated with the inclusion of differential 
encoding/decoding in the system. The quantification of this performance penalty 
is discussed later in the book. 

3. 1.4. 1 n / 4-QPSK. Depending on the set of M phases {A $■} used to represent 
the information phase A 6 n in the nth transmission interval, the actual transmitted 
phase 0 n in this same transmission interval can range either over the same set 

6 We note that this receiver (i.e., the one that makes optimum coherent decisions on two successive 
symbol phases and then differences these to arrive at the decision on the information phase) is 
suboptimum when M > 2 [3]. However, this receiver structure, which is the one classically used for 
coherent detection of differentially encoded M-PSK, can be arrived at by a suitable approximation 
of the likelihood function used to derive the true optimum receiver and at high SNR the difference 
between the two becomes mute. 

7 Note that we have shifted our notation here insofar as the information phases are concerned so as 
to keep the same notation for the actual transmitted phases. 



IDEAL COHERENT DETECTION 41 



{/S,} = {A /?,-} or over another phase set. If for M = 4 we choose the set A/3, = 
0, n/2, 7T, 37t/ 2 to represent the information phases, then starting with an initial 
transmitted phase chosen from the set n/A, 3n/4, 5 tt/ 4, In /4, the subsequent 
transmitted phases {0 n } will also range over the set tt/ 4, 3n/4, 5n/4, lit/ 4 
in every transmission interval. This is the conventional form of differentially 
encoded QPSK. Now suppose instead that the set A/S,- = n/4, 3n/4, 5n/4, ln/4 
is used to represent the information phases {A 6 n }. Then, starting, for example, 
with an initial phase chosen from the set 7 t/4, 37t/4, 57t/4, 77t/ 4, the transmitted 
phase in the next interval will range over the set 0, n/2, n, 3 tt/2. In the following 
interval the transmitted phase will range over the set n/4, 3n/4, 5n/4, In /4, 
and in the interval following that one the transmitted phase will once again 
range over the set 0, n/2, n, 3n/2. Thus we see that for this choice of phase set 
corresponding to the information phases {A 6 n }, the transmitted phases {6„ } will 
alternatively range over the sets 0, n/2, n, 3n/2 and 7r/4, 37 t/ 4, 57r/4, ln/4. Such 
a modulation scheme, referred to as n/4-QPSK [4], has an advantage relative to 
conventional differentially encoded QPSK as follows. 

In the case of conventional differentially encoded QPSK, the maximum change 
in phase from transmission to transmission (which occurs when both I- and Q- 
channel data streams switch polarity) is n radians, which results in a complete 
reversal (maximum fluctuation) of the instantaneous amplitude of the transmitted 
waveform. In the case of jt/ 4-QPSK, the maximum change in phase from 
transmission to transmission is 3n/4 radians, which clearly results in a smaller 
instantaneous amplitude fluctuation. On nonlinear transmission channels the 
fluctuation of the instantaneous amplitude is related to the regeneration of spectral 
sidelobes of the modulation after bandpass filtering and nonlinear amplification at 
the transmitter — the smaller the instantaneous amplitude fluctuation, the smaller 
the sidelobe regeneration, and vice versa. On a linear AWGN channel with 
ideal coherent detection, there is theoretically no advantage of 7i/4-QPSK over 
conventional differentially encoded QPSK; in fact, the two have identical error 
probability performance. 

3.1 .5 Offset QPSK or Staggered QPSK 

For the same reason as using jt/ 4-QPSK versus conventional differentially 
encoded QPSK on a nonlinear channel, another form of QPSK, namely, offset 
QPSK ( OQPSK ) [alternatively called staggered QPSK (SQPSK)] has become 
quite popular. OQPSK or SQPSK is a form of QPSK wherein the I and Q signals 
components are misaligned with respect to one another by half a symbol time 
(i.e., a bit time) interval. In mathematical terms, the complex carrier is amplitude 
modulated by a/(?) + JciqU), where 

ai(t) = ^2 a In p(t-nT s ), a Q (t) = ^ a Qn p(t - nT s - T s / 2) (3.16) 



where a/ n and oq„ are the I and Q data symbols for the nth transmission interval 
that take on equiprobable ±1 values. Thus, in the nth transmission interval 
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corresponding to the I channel, the transmitted signal has the complex form 



s(t) = 



A c (a In + ja Qn -\ 

A c {ai n + ja Qn )eK 2 ”f‘ t+e ‘\ 



nT s <t< (n + ±)T s 
{n + \)T s <t< (n + l)T s . 



(3.17) 



Similarly, for the nth transmission interval corresponding to the Q channel, the 
transmitted signal has the complex form 



A c (a In + ja Qn )eA 2 *f* t+e '\ 
A c {a, t n+\ + ja Qn )eA 27T fc t+e c\ 



[n + \)T, < t < (n + 1)T S 
(n+l)T s <t< (n + \)T s . 



(3.18) 



At the receiver the signal x(t) = s(t ) + h(t) is complex-conjugate demodulated 
by c r (t) and then matched filtered producing the I and Q decision variables 
(Fig. 3.7) 



yin 



ai n A c T s + N In, 



y< 2 n = a Qn A c T s + N Qn 



N, n = Re 



Nq„ = Im 



( f(n+l)T s 'v 

{ L, 

[Ur. ^ 



(3.19) 



each of which is hard-limited to produce decisions on the I and Q transmitted 
amplitudes. Note that independent of the time offset between the I and Q channels, 
the decision variables of (3.19) have statistics identical to those of conventional 
QPSK as given by (3.15). Thus, for ideal coherent detection, QPSK and OQPSK 
have identical error probability performance, as will be reiterated later in the 
book. 

Returning now to the issue of spectral sidelobe regeneration on a nonlinear 
channel, since the I and Q channels do not change phase at the same time instant 
(i.e., they are staggered by half a symbol with respect to each other), a phase 
change of n radians cannot occur instantaneously. Rather, if both the I and Q 
channels switch data polarities, the n radians that ultimately results occurs in 
two steps: after half a symbol the phase changes by n!2 radians, and then after 
the next half a symbol the phase changes by another nil radians. Thus we see 
that at any given time instant, the maximum change in phase that can occur is 
nil radians, which results in a smaller instantaneous amplitude fluctuation than 
either 7T/4-QPSK or conventional differentially encoded QPSK. 

In summary, on a linear AWGN channel with ideal coherent detection, all 
three types of differentially encoded QPSK (i.e., conventional, 7r/4, and offset) 
perform identically. The differences among the three types on a linear AWGN 
channel occur when the carrier demodulation phase reference is not perfect (i.e., 
nonideal coherent detection). 
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3.1.6 M-ary Frequency-Shift-Keying 

An M-ary frequency-shift-keyed (M-FSK) signal occurs when /(f) takes on 
equiprobable values £,■ = (2 i — 1 — M)Af/2, i = 1, 2, . . . , M, in each symbol 
interval T s where the frequency spacing A/ is related to the frequency modulation 
index hby h = A/T v . As such, /(f) is modeled as a random pulse stream, that is, 

f(t)= Y, fnP(t~nT s ) (3.20) 

where /„ is the information frequency in the nth symbol interval nT s <t < 
( n + 1 )T S ranging over the set of M possible values as above, and p(t) is 
again a unit amplitude rectangular pulse of duration T s seconds. Thus the complex 
signal transmitted in the nth symbol interval is 

5(f) = A c e jl ^ (fct+Mt ~ nTs))+9cl (3.21) 

Note here that in contrast to the amplitude- and phase-shift-keying modulations 
discussed previously, the complex baseband modulation S(t) = A c e^ n(t ~ nTs> is 
not constant over this same interval but rather has a sinusoidal variation. After 
demodulating with the complex conjugate of c r (f) at the receiver, we obtain 

x(t) = A c e j2 * f " it - nT ‘ ) + N(t) (3.22) 

Multiplying (3.22) by the set of harmonics e ~ il7l ^ k{f ~ nT ’ ) , k = 1,2 , ,M, and 
then passing each resulting signal through an I&D produces the decision variables 
(Fig. 3.8) 



r(n+l)T s 

y nk =A C e j2n(f n -H t )(t-nT s ) d{ + 

JnT s 

Mn+l)T s 

N nk = / e~ ]2 ^ k(, - nTs) N(t)dt 

JnT s 



k= 1,2, ...,M, 



(3.23) 



from which a decision corresponding to the largest Re{y n i} is made on the 
information frequency transmitted in the nth signaling interval. 

For orthogonal signaling wherein the cross-correlation Rcj /^ 1 l)7 ' t Sk(t)s* (f) dt} 
= 0, k f l, the frequency spacing is chosen such that A / = N /2T S with 
N integer. If, for example, the transmitted frequency /„ is equal to %i = 
(2/ — 1 — M)A//2, then (3.23) can be expressed as 



%k 

Nnk 



A T ~ k)N/2] ^ 

c s n(l- k)N/2 



k= 1,2, ...,M, 



e -M2k-l-MW/2T^ (t + nTs)dt 



(3.24) 
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Figure 3.8. Complex form of optimum receiver for ideal coherent detection of M-FSK over the 
AWGN. 



or, taking the real part, 



k = 1,2, ... ,M (3.25) 



Thus we observe that for orthogonal M-FSK, only one decision variable has a 
nonzero mean: the one corresponding to the transmitted frequency. That is, 



Ref|g} = A C T S , Re{g$f = 0, k^l (3.26) 



A popular special case of M-FSK modulation is binary FSK (BFSK), 
which corresponds to M = 2. In addition to orthogonal signaling (zero cross- 
correlation), it is possible to choose the modulation index so as to achieve the 
minimum cross-correlation that results in the minimum error probability (see 
Chapter 8). Since for arbitrary A/ we have 



Re *Si (t)~s* 2 (t)dt | =Re| A 2 C " e~ j:blAft dt J 



sin27rA/Tfe 
6 2nAfT b 



the minimum of this cross-correlation is achieved when h = AfTb = 0.715 [1], 
which results in a minimum normalized cross-correlation value 









IDEAL COHERENT DETECTION 45 



•or 



e {/r 

■Lt, 



- I A fTb=0.7\5 = -0.217 2 



3.1.7 Minimum-Shift-Keying 

Consider a BFSK signal whose phase is maintained continuous from bit interval to 
bit interval, called continuous phase frequency-shift-keying (CPFSK) [5]. Because 
of this phase continuity, such a modulation has memory, and thus data bit 
decisions should be based on an observation longer than a single bit interval. A 
special case of CPFSK corresponds to a modulation index h = \ and is referred 
to as minimum-shift-keying (MSK) [6,7], For this special case, the transmitted 
signal in the nth bit interval takes the form 

~s(t ) = A c e j ^ f ‘ t+d ’ (M,llTb)+x ’\ nT b < t < (n + 1 )T b (3.29) 

where d n is the binary (± 1 ) information bit and x n is chosen to maintain the phase 
continuous at t = nT b . Writing (3.29) in the form that characterizes the (n — l)st 
bit interval, to maintain the phase continuous at t = nT b it is straightforward to 
show that, assuming an initial condition X- x = 0, the phase x n satisfies the 
relation 

Xn=x n - l +™(d n -i-d n ) (3.30) 

and thus can only take on values (0, n) (modulo 2jt). Substituting (3.30) into 
(3.29) and applying simple trigonometry it can be shown that MSK has an 
equivalent I-Q form that resembles OQPSK with, however, a pulse shape that 
is not rectangular. Specifically, an MSK signal has the pulse-shaped OQPSK 
representation 

~s(t) = A c [ai(t) + ja Q (t)]e jM+dc) (3.31) 

where aj(t ) and OqU) are random data streams of the form in (3.16), with binary 
(±1) data symbols (each of duration T s = 2 T b ) 

a In = cos x n , aQ n = d n cosx n = d„ai n (3.32) 

and p{t) is a half sinusoid of duration T s , that is, 

f nt T s T s 

pit ) = < cos Y s ’ ~ t ~^2 

lo, 



otherwise. 



(3.33) 




Unity Transmission 
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Note that the pulse shape for the Q data stream is 



P 




0 < t < T s 
otherwise. 



(3.34) 



There exists a direct relation between the binary data bits {d n } of the frequency 
modulation form of MSK in (3.29) and the equivalent binary data bits {a/„} and 
{dQ„} of the I-Q form in (3.31). In particular, {«/„} and {ciq„} are the odd 
and even bits of the differentially encoded version of {a n } (Fig. 3.9). That is, if 
v n = d n v n - 1 is the differentially encoded version of d n , the equivalent I and Q 
data bits are given by 



am = (- l) n+1 V2n+u a Qn = (- l) n+1 v 2n (3.35) 



Thus, if the MSK modulation is implemented by continuous phase frequency 
modulating the carrier oscillator with the sequence { d n } and the data are to 
be recovered by implementing a pulse-shaped OQPSK receiver (Fig. 3.10), then 
following the interleaving of the I and Q decisions {d/ n ) and {ciq„ }, one must undo 
the implicit differential encoding operation at the transmitter and thus employ 
a differential decoder to obtain the decisions on the information bits {d n }. To 
get around the need for differential decoding at the receiver and the associated 
performance penalty (discussed in Chapter 8), one can precode the data entering 
the MSK modulator with a differential decoder, resulting in precoded MSK [1, 
Chap. 10]. The combination of differential decoder and MSK modulator is then 
identically equivalent to a pulse-shaped OQPSK modulator whose equivalent I 
and Q binary data bits {fl/ n } and {oq„ } are now just the odd and even bits of 
[d n ] itself (Fig. 3.11). That is, if prior to frequency modulating the carrier the 
information bits {d n } are first differentially decoded to the sequence { u n } , where 
u„ = d n d„- 1 , the equivalent I and Q bits for the pulse-shaped OQPSK modulator 
would be 

a,n = (-l) n+1 d 2n+1 , a Qn =(-\) n+l d 2n (3.36) 



Thus, for precoded MSK, no differential decoder is needed at the receiver in order 
to recover the decisions on {d n } (Fig. 3.12). Since the precoder has no effect on 
the power spectral density of the transmitted waveform, then from a spectral point 
of view, MSK and pulse-shaped OQPSK are identical. Thus, from this point on, 
when discussing MSK modulation and demodulation, we shall assume implicitly 
that we are referring to precoded MSK or equivalently, pulse-shaped OQPSK. 



3.2 NONIDEAL COHERENT DETECTION 

In Section 3.1 we considered the ideal case of phase coherent detection wherein 
it was assumed that the attributes of the local carrier used to demodulate the 
received signal were perfectly matched to those of the transmitted carrier [i.e., 
c r (t) = c t (t)\. In practice, this ideal condition is never met since the local 





Figure 3.10. Complex form of optimur 
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Modulator 




carrier must be derived from the received signal itself, which contains the 
random perturbations introduced by the channel (e.g., the additive noise, fading, 
Doppler shift, etc.). Regardless of the manner in which the receiver creates its 
demodulation reference, there will result a mismatch between the phase and 
frequency of the received carrier and that of the locally generated carrier. Ignoring 
any frequency mismatch, if, as before, 9 C denotes the phase of the received carrier 
and 9 C now denotes the phase of the locally generated carrier at the receiver, the 
phase error (j> c = 9 c — 9 C would be a random variable with a specified PDF p(<t> c ), 
which, in general, depends on the scheme used for extracting the phase estimate 
9 C . We shall have more to say about the form of this PDF momentarily. For the 
special case of ideal phase coherent detection treated in Section 3.1, the phase 
error PDF was assumed to be a delta function [i.e., p(4> c ) = ^(4>c)\- 

When the nonideal carrier reference signal as above is used to demodulate 
the received signal, two possibilities exist with regard to the manner in which 
detection is subsequently performed. On the one hand, the detector can be 
designed assuming a perfect carrier reference (i.e., ideal coherent detection) with 
the nonideal nature of the demodulation reference accounted for in evaluating 
receiver performance. This is the case to which we direct our attention in this 
section. On the other hand, given the PDF of the phase error, p(<j) c ), the remainder 
(baseband portion) of the receiver can be designed to exploit this statistical 
information, thereby coming up with an improved detection scheme. Such a 
scheme, which makes use of the available statistical information on the carrier 
phase error to optimize the design of the detector, is referred to as partially 
coherent detection and is discussed in Section 3.4. 










P(t-nT s ) 
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Figure 3.12. Complex form of optimum receiver for ideal coherent detection of precoded MSK (pulse-shaped 
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Returning now to the manner in which the locally generated carrier is obtained 
at the receiver, the most common method for accomplishing this purpose is to 
employ a carrier synchronization loop 8 (e.g., a Costas loop), decision-directed 
loop, or form thereof [2, Chap. 2] that regenerates a carrier by continuously 
estimating the phase and frequency of the data-bearing received signal. Such 
loop structures are motivated by the MAP estimate of the carrier phase of a 
suppressed carrier signal and precede the data detection portion of the receiver. 
For a broad class of carrier reconstruction loops of the type mentioned above, 
the PDF of the modulo 27r-reduced phase error can be modeled as a Tikhonov 
distribution [10] which has the generic form 9 



p(0c) = 



exp(p c cos 0 C ) 

2nl 0 (p c ) ' 



(3.37) 



with p c called the loop SNR. 

Another method for producing the necessary carrier synchronization at the 
receiver is to transmit a separate unmodulated carrier along with the data- 
modulated carrier and extract it at the receiver for use as the demodulation 
reference. Detection schemes based on such a transmitted reference are referred 
to as pilot tone -aided detection techniques and have the advantage that the 
method of extraction [e.g., a phase-locked loop (PLL) or narrowband filter] is 
not encumbered by the presence of the unknown data. On the other hand, for a 
given amount of total power, a portion of it must be allocated to the pilot signal 
and thus is not available for purposes of data detection. 

In yet another method, a combination of the received signals in the previous 
intervals, the simplest case being just that from the previous interval, is used 
directly as the demodulation reference. Such detection schemes are based on 
observation of the received signal for more than a single symbol interval and 
are referred to as differential detection. Since these schemes in effect integrate 
the carrier demodulation as part of the detection operation, they are usually 
considered to form a class of their own, and we treat them as such in Section 3.5. 

In accordance with the discussion above, the mathematical model used to 
define the demodulation reference signal is a complex carrier with a phase equal 
to the estimate of the received carrier phase [i.e., c r (t) = e-' (2n ^ :H "• 1 ]. Thus, 
for any of the complex bandpass transmitted signals sit) = A c a{t)e^ 27T ^ :l+6c \ 
s(t) = A c e jl2n ^ ct+ec+e ^\ or s(t) = A c e^ l7z{(c+ f <t))t+()c \ the received signal after 
complex-conjugate demodulation becomes x{t) = S{t)e^ c + N(t), which takes 
on the specific forms x(t) = A c a(t)e j<l>c + N (t), x{t) = A c a(t)e j[e ^ +<l>c] + N(t), 
and x(t ) = A c a(t)eJ' i f {t)t+<i>, \ + N(t), respectively, where N(t) = n(t)c*{t ) is again 
a zero-mean baseband complex Gaussian process. Since (p c is constant over 



8 Open-loop carrier synchronization techniques are also possible (see, e.g., Refs. 8 and 9), but are 
beyond the scope of our discussion here. 

9 The modeling of the phase error PDF for a phase-locked loop (PLL) in the form of (3.37) was also 
arrived at independently by Viterbi [11]. 
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the symbol (bit) interval 10 the outputs of the matched filter for each of these 
types of modulation are as given in Section 3.1 [e.g., (3.4), (3.13), and (3.23), 
multiplied by e^ c ]. As such, one can view the receiver structures for nonideal 
phase coherent detection as having baseband equivalents to those of ideal phase 
coherent detection with the addition of a phase rotation <p c . Thus, if as before 
y nk , k = 1, 2, . . . , M, denotes the set of matched filter outputs for ideal phase 
coherent detection of the nth symbol, the decision variables for nonideal phase 
coherent detection in that same interval become y n k ^ c , k = 1,2 , ,M, where 
t p c is distributed according to (3.37) or an appropriate variation thereof and is 
assumed to be independent of the y n/ t’s. Equivalently, one can postulate a complex 
baseband receiver model where the kth matched filter output in the nth symbol 
interval is 

ynk=he j0c +N nk (3.38) 

which is then complex-conjugate demodulated by the complex baseband nonideal 
reference c r = e jf>c . Here s k represents the signal component of the matched filter 
output under ideal phase-coherent conditions [i.e., the k\h matched filter response 
to the complex baseband transmitted signal S(t)]. 

Another mathematical model for nonideal phase coherent detection, which 
is based on the complex baseband equivalent receiver above, is to treat the 
randomness of the phase of the demodulation reference c r = e' 6, as an equivalent 
AWGN source. As such, c r is modeled as the sum of an ideal phase coherent 
reference and a Gaussian random variable, that is, 

~c r = '/GA r e j9c +N r (3.39) 

where G is a normalized gain factor intended to reflect the SNR of the carrier 
synchronization technique used to produce 9 C in the actual physical model. 
Although few carrier synchronizers produce a complex Gaussian reference signal, 
pragmatically, the mathematical nonideal reference model described by (3.39) 
has been demonstrated by Fitz [9,12] to be an accurate approximation of 
a large class of nonlinear phase estimation techniques (including the above- 
mentioned carrier synchronization architectures) in evaluating the average error 
probability performance of the system for moderate- to high-SNR applications. 
The advantage of the representation in (3.39) is that it affords a unified analysis 
akin to that suggested by Stein [13] wherein the demodulation phase reference 
signal and the matched filter output are both complex Gaussian processes and 
thus includes as a special case conventional (two-symbol observation) differential 
detection corresponding to G = 1 (see Section 3.5). This representation has a 
similar unifying advantage when evaluating the average error probability of such 
nonideal phase coherent systems in the presence of certain types of fading (see 
Chapter 8). 

10 We assume here the case where the data rate is sufficiently high relative to the carrier 
synchronization loop bandwidth that the phase of the demodulation reference produced by this 
loop is essentially constant over the duration of the data symbol. 
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3.3 NONCOHERENT DETECTION 

In the preceding two sections it was assumed that either the carrier phase 
reference was provided to the receiver exactly (idealistically, by a genie), or 
at the very least an attempt was made to estimate it. At the other extreme, 
one can make the much simpler assumption that the receiver is designed 
not to make any attempt at estimating the carrier phase at all. Thus the 
local carrier used for demodulation is assumed to have an arbitrary phase 
which, without any loss in generality, can arbitrarily be set to zero. Detection 
techniques based on the absence of any knowledge of the received carrier 
phase are referred to as noncoherent detection techniques. In mathematical 
terms, the receiver observes the equivalent baseband signal R(t) = ~r(l)e~ l2n ^ t = 
S(t)e j9c + h(t)e~' 2n ^‘ , where 9 C is unknown [and thus may be assumed to be 
uniformly distributed in the interval (—it, n)] and attempts to make a decision 
on S(t). 

The optimum receiver under such a scenario is well known [1] to be a 
structure that incorporates a form of square-law detection. Specifically, in each 
symbol interval the receiver first complex-conjugate demodulates the received 
signal with the zero-phase reference signal c r (t) = e j2n ^ ct , then passes the 
result of this demodulation through M matched filters, one each corresponding 
to the transmitted baseband signals. The decision variables are then formed 
from the magnitudes (or equivalently, the squares of these magnitudes) of 
the matched filter outputs and the largest one is selected (see Fig. 3.13). In 
mathematical terms, the decision variables (assuming square-law detection) are 
given by 



Znk=\ynk\ 2 =y„" T +1)TS m~S* k (t)dt\ , k = 1,2, ... ,M (3.40) 

where Sk(t), k = 1, 2, . . . , M, is the set of possible realizations of S(t) and the 
decision is made in favor of the largest of the z n k s. 

Suppose now that the modulation was, in fact, M-PSK and one attempted to 
use the receiver above for detection. Since in the absence of noise the matched 
filter outputs in the nth symbol interval would be given by [see Eq. (3.13), 
now with the addition of the unknown carrier phase 6 C \ y n k = ^ c T s e ,[e>n A) £ ,.A, 
k = 1 , 2, . . . , M, the magnitudes of these outputs would all be identical and hence 
cannot be used for making a decision on the transmitted phase 9 „ . Stated another 
way, since for M-PSK the information is carried in the phase of the carrier, then 
since the noncoherent receiver is designed to ignore this phase, it certainly cannot 
be used to yield a decision on it. In summary, noncoherent detection cannot be 
employed with M-PSK modulation. 

Having ruled out M-PSK modulation (which would also rule out binary AM 
because of its equivalence with BPSK), the next most logical choice is M-FSK. 
Based on the results obtained in Section 3.1.6 for the matched filter outputs under 
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Figure 3.13. Complex form of optimum receiver for noncoherent detection over the AWGN. 
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ideal phase coherent conditions, we immediately write these same outputs for the 
noncoherent case as 

r(n+ 1)T, 

y nk = A c e J0c J e ]^(fn-m-nT s ) dt +N nk , k = 1 , 2, . . . , M, 

r(n+m 

N nk = J e - J2 ^ t( *- m) N(t)dt (3.41) 

where now N(t) = h(t)e' 2nf ' 1 . Taking the absolute value (or its square) of the 
y nk s in (3.41) in the absence of noise removes the unknown carrier phase but 
leaves the data information, which is now carried in the frequency /„ , unaltered. 
Thus it is feasible to use noncoherent detection with M-FSK modulation. Note, 
however, that the additional use of an envelope (or square-law) detector following 
the matched filters in the noncoherent case will result in a performance penalty 
relative to the coherent case, where the decision is made based on the matched 
filter outputs alone (see Chapter 8). 



3.4 PARTIALLY COHERENT DETECTION 

3.4.1 Conventional Detection: One-Symbol Observation 

In Section 3.2, the assumption was made that although the true carrier demodu- 
lation was accomplished prior to data detection, the design of the detector was 
not in any way influenced by the randomness of the phase error statistics at the 
output of the demodulator (i.e., the form of the detector that is optimum for ideal 
phase coherent detection was still employed). When the statistics of the phase 
error are taken into account in the design of the detector, then based on observa- 
tion of a single symbol interval, it can be shown [1,14] that the optimum detector 
is a linear combination of the coherent and noncoherent detectors discussed in 
Sections 3.1 and 3.3, respectively. In mathematical terms, the decision variables 
{z n k) are formed from the matched filter outputs as 

Znk = (Re{y„*} + p c N 0 /2f + (\m{y nk \f, k=l,2,...,M (3.42) 

or ignoring the term ( p c No/2 ) 2 , which is common to all M z n k s, we have the 
equivalent decision variables (keeping the same notation) 

;„, = (T R e <j„ tl ) +(T Im{ W ) +ft(^Re{M) 



k = 1,2, ... ,M 



(3.43) 
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Figure 3.14. Complex form of optimum receiver for partially coherent detection over the AWGN. 
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where the first term is characteristic of noncoherent detection and the second 
term is characteristic of coherent detection. A receiver implementation based 
on (3.43) is illustrated in Fig. 3.14. Note that knowledge of both p c and N o 
is required to implement this receiver. Such knowledge must be obtained by 
measurements taken on the channel and the accuracy of this knowledge will 
have an impact on the ultimate performance of the receiver. Since as mentioned 
in Section 3.3 for M-PSK modulation the first (noncoherent) term of (3.43) does 
not aid in the decision-making process, it can be ignored and hence the optimum 
partially coherent receiver of M-PSK reduces to the coherent receiver (Fig. 3.8 
with a nonideal reference signal) whose performance is determined on the basis 
of the decision variables in Section 3.2. Regardless of the type of modulation, 
for p c = 0, the receivers of Fig. 3.14 reduce to those for noncoherent detection 
whereas for p c = oo they reduce to those for coherent detection. 



3.4.2 Multiple Symbol Detection 

Suppose now that we consider partially coherent detection of M-PSK based 
on an observation greater than a single symbol interval. If the phase error, </> c , 
between the received carrier phase and the receiver’s estimate of it is sufficiently 
slowly varying that it can be assumed constant over say N s symbol intervals 
(N s > 2), then an iV s -symbol observation of the received signal now contains 
memory, and the receiver should be able to exploit this property in arriving at an 
optimum design with improved performance [1, Chap. 6; 15]. As in any optimum 
(ML) receiver for a modulation with memory transmitted over the AWGN, the 
structure should employ sequence detection [i.e., joint (rather than symbol-by- 
symbol) decisions should be made on groups of N s symbols on a block-by-block 
basis]. 

Analogous to the results in Section 3.4.1, the optimum detector based on an 
observation of the received signal now spanning N s symbols, is again a linear 
combination of coherent and noncoherent detectors in which a set of M Ns decision 
variables is formed from the matched filter outputs to enable selection of the most 
likely A s -symbol sequence of phases. In mathematical terms, the M Ns symbol- 
by-symbol matched filter outputs 

r (n-i+\)T s 

y n _i k . = / R(t)S* k . (?) dt, ki = 1 , 2, . . . , M, 

i = 0, 1, ...N s - 1 (3.44) 

with 

S ki (?) = A c e it>k < = A c e j(2k ’- ])7T/M , kj = 1,2, ... ,M (3.45) 

are summed over i in groups of size N s and then used to produce the M Ns 
decision variables 




Delay ) ^ | Delay| _ [Delay) 





Figure 3.15. Complex form of optimum receiver for multiple symbol partially coherent detection over the AWGN. 
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(3.46) 



The notation in (3.44), (3.45), and (3.46) is used to indicate the fact that for each 
value of the transmission interval index i in the range 0 to N s — 1, the transmitted 
signal index k can range over the set 1,2 , ,M. Also, the boldface subscript 
k on the variable z n denotes the vector {k\ , ka, , kw s - 1 ). Finally, a decision is 
made on the transmitted phase sequence in the observation interval in accordance 
with the largest of the z„k’s. Clearly, for N s = 1, (3.46) reduces to (3.43). 

Note that for N s > 1, the first (noncoherent) term in (3.46) in the absence 
of noise is not identical for all phase sequences and thus contributes to the 
decision-making process. This term does, however, have an associated phase 
ambiguity in that multiplication of each term in the sum by e~ je - where 6 a is 
an arbitrary fixed phase, does not change the value of the term. Hence, based 
on the first term alone (i.e., for p c = 0), the decision on the transmitted phase 
sequence would be ambiguous by 9 a radians, where 0 a could certainly assume 
the value of one of the transmitted information phases. The second term in 
(3.46) does not have such an associated phase ambiguity, and thus for p c ^ 0 
the decision rule would be unique. To guarantee a unique decision rule for the 
p c = 0 case, one can employ differential phase encoding of the information 
phase symbols as discussed in Section 3.1.4. The specific details of how such 
differential encoding provides for a unique decision rule in this special case is 
discussed in Section 3.5 in connection with differential detection of M-PSK with 
multiple symbol observation. Figure 3.15 is an illustration of a partially coherent 
receiver for M-PSK based on the decision statistics of (3.46). The performance 
of this receiver is presented in Chapter 8. 



3.5 DIFFERENTIALLY COHERENT DETECTION 
3.5.1 M-ary Differential Phase Shift Keying 

Suppose once again that one does not specifically attempt to reconstruct a 
local carrier at the receiver from an estimate of the received carrier phase. We 
saw in Section 3.3 that for an observation interval corresponding to a single 
transmitted symbol, the optimum noncoherent receiver could not be used to detect 
M-PSK modulation. Instead let us now reconsider the noncoherent detection 
problem assuming an observation interval greater than one symbol in duration. 
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This problem is akin to the partially coherent detection problem considered 
in the preceding section except that the memory that is introduced into the 
modulation now comes directly from the received carrier phase 0 C (assumed 
to be constant over, say, N s symbols) rather than the phase error <p c that results 
from its attempted estimation. As such, the maximum-likelihood solution to the 
problem would involve averaging the conditional likelihood function based on 
an A^-symbol observation over a uniformly distributed phase (i.e., 9 C ) rather 
than a Tikhonov-distributed phase (i.e., <p c ). Receivers designed according to 
the foregoing principles are referred to as differential detectors and clearly 
represent an extension of noncoherent reception to the case of multiple symbol 
observation. The term differential came about primarily due to the fact that 
in the conventional technique, a two-symbol observation is used (N s = 2) and 
thus, as we shall see, the decision is made based on the difference between two 
successive matched filter outputs. However, Divsalar and Simon [16] showed 
that by using an observation greater than two symbols in duration, one could 
obtain a receiver structure that provided further improvement in performance in 
the limit as N s oo, approaching that of differentially encoded M-PSK (see 
Section 3.1.4). Practically speaking, it is only necessary to have N s on the order 
of 3 to achieve most of the performance gain. With a little bit of thought, it should 
also be clear that the Tikhonov PDF of (3.37) with p ( j > = 0 becomes a uniform 
PDF, and thus from the above-mentioned analogy, the solution to the multiple- 
symbol (including N s = 2) differential detection problem can be obtained directly 
as a special case of the results obtained for the multiple-symbol partially coherent 
detection problem. 

3.5.1. 1 Conventional Detection: Two-Symbol Observation. We begin 
our discussion of differential detection of M-PSK by considering the conventional 
case of a two-symbol observation. Based on the discussion above, the decision 
variables can be obtained from the first term of (3.46) with N s = 2. Substituting 
(3.44) together with (3.45) in this term gives 

z - k = Gi) &A + % ~' M |2 

(A \ 2 I ff n+iyr ‘ fiT, i 2 

= | J R(t)e~ jflk o dt + j R(t)e~ jf>k i dt | , 

ko,ki = 1,2, ...,M (3.47) 

where f J >k 0 represents the assumed value for the information phase 9<) transmitted in 
the nth symbol interval and represents the assumed value for the information 
phase 6L| transmitted in the (n — l)st symbol interval. As mentioned above, 
multiplying each of the two matched filter outputs in (3.47) by e~'° r ‘ with 
0 a arbitrary does not change the decision variables. To resolve this phase 
ambiguity we employ differential phase encoding at the transmitter as discussed 
in Section 3.1.4. In particular, the transmitted information phases, now denoted 
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by {A 0 n ], are first converted (differentially encoded) to the set of phases {6„ } in 
accordance with the relation 

0 n = 0 n - 1 + A 0 n modulo 2tt (3.48) 

where /3/. (l and fik, in (3.47) now represent the assumed values for the differentially 
encoded phases in the nth and ( n — l)st symbol intervals, respectively. Note that 
for 0 n and Q n -\ to both range over the set ftk = (2 k — 1 )n/M, k = 1,2 , ,M, 
we must now restrict the information phase A 6 n to range over the set A/3/. = 
2 kn/M, k = 0, 1, 2, . . . , M — 1. If we now choose the arbitrary phase equal to 
the negative of the information phase in the ( n — l)st interval (i.e., 0 a = — #t 0 ), 
then multiplying each matched output term in (3.47) by e~^ a = we can 
rewrite (3.47) as [ignoring the ( A c /No ) 2 scaling term] 

I An+\)T S rnT, | 2 

Znk = \ R(t)dt+ I R(t)e- m -^dt\ 

\JnT s J(n-\)T S 

I An+\)T S r nT, | 2 

= / R(t)dt+ / R(t)e~ JAf>k dt\ , 

\JnT s J(n—l)T s 

k =0, 1 ..... M — 1 (3.49) 

Choosing the largest of the z n k s in (3.49) then directly gives an unambiguous 
decision on the information phase A 0 n . Expanding the squared magnitude in 
(3.49) as 

I r(n+l)T, rnT„ 1 2 

/ R(t)dt+ R(t)e~ jAf!t dt\ 

\JnT, J(n-\)T, \ 

I /•(«+!)'/; I 2 I rnT, I 2 

= / R(t)dt\ + / R(t)e~ ]Ah dt\ 

I JnT, I \J(_n-l)T s \ 

+ 2 Re | ^ + } S R(t) dtj ^ R(t)e- jAh dt'j | (3.50) 

and noting that the first two terms of (3.50) are independent of the decision index 
k, an equivalent decision rule is to choose the largest of 




M - 1 



(3.51) 
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Figure 3.17. Complex form of optimum receiver for conventional (two-symbol observation) 
differentially coherent detection of DPSK over the AWGN. 



A receiver that implements this decision rule is illustrated in Fig. 3.16 and is the 
optimum receiver under the constraint of a two-symbol observation. For binary 
DPSK, the decision rule simplifies to 



r (, 


f /-(n+Dn _ \* 


f r n ~ \ 1 


R e 


/ R(t)dt) 


/ R(t)dt)\ 


L l' 


JnT b J ' 


J(n-1)T„ J J 



and is implemented by the receiver illustrated in Fig. 3.17. Note that the structure 
of the receiver in Fig. 3.16 and its special case in Fig. 3.17 is such that the 
previous matched filter output acts as the effective baseband demodulation 
reference for the current matched filter output. In this context the differentially 
coherent receiver behaves like the nonideal coherent receiver discussed in 
Section 3.2 with a reference signal as in (3.39) having a gain G = 1 and an 
additive noise independent of that associated with the received signal. 



3.5. 1.2 Multiple-Symbol Detection. Analogous to what was true for 
partially coherent detection, the performance of the differentially coherent detec- 
tion system can be improved by optimally designing the receiver based on an 
observation of the received signal for more than two symbol intervals [16]. 
The appropriate decision variables are now obtained from the first term of 
(3.46) with N s > 2. Once again using differential phase encoding to resolve the 
phase ambiguity inherent in this term — in particular, setting the arbitrary phase 
0 a = —6 n -N s + i and using the differential encoding algorithm of (3.48) — we 
obtain analogous to (3.49) the decision variables 



+ C 



DT 

R(t)dt 

[n-N s +2)T s 



-N s +l)T s 



[ ' R(t)e~ jA dt -1 
J (n— I )T, 

dt\ , 



ki = 0, 1, 



M- 1, f = 1,2, 



N s - 1 



(3.53) 
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from which a decision on the information sequence A6„-n s+ 2, A0„_/v s+ 3, . . . , 
A0 n - 1 , A 9 n is made corresponding to the largest of the z„k’s. Note that an N s - 
symbol observation results in a simultaneous decision on N s — 1 information 
phase symbols. The squared magnitude in (3.53) can be expanded analogous to 
(3.50) to simplify the decision rule. For example, for N s = 3 the decision rule 
is to choose the pair of information phases A0„_i, A 0„ corresponding to the 
maximum over k\ and k 2 of 

+e ^UZ,, km, )\C 

+ g -AAA,+AA 2 ) ^ + ) ' R(t)dt^ ^ )S R(t)dt 

k u k 2 = 0, 1 (3.54) 

A receiver that implements this decision rule is illustrated in Fig. 3.18. 

We conclude this section by mentioning that although it appears that 
the complexity of the receiver implementation grows exponentially with the 
observation block size N s [1, Sec. 7.2.3], Mackenthun [17] has developed 
algorithms for implementing multiple symbol differential detection of M-PSK 
that considerably reduce this complexity, thus making it a feasible alternative to 
coherent detection of differentially encoded M-PSK. These algorithms and their 
complexity in terms of the number of operations per A^-symbol block being 
processed are also discussed in Ref. 1. 

3.5.2 jr/4-Differential QPSK 

The 7T/4-QPSK introduced in Section 3. 1.4.1 in combination with coherent 
detection as a means of reducing the regeneration of spectral sidelobes in 
bandpass filtered/nonlinear systems can also be used for the same purpose when 
combined with differential detection. The resulting scheme, called n/4-differential 
QPSK (n/4-DQPSK), behaves quite similar to ordinary differential detection of 
QPSK as discussed in Section 3.5.1, with the following exception. Since the 
set of phases { A/3^} used to represent the information phases {A 0„] is now 
Afa = (2 k — 1)tt/4, k = 1, 2, 3, 4, this set must be used in place of the set 
Afa = k: r/4, k = 0,1, 2, 3, in the phase comparison portion of Fig. 3.16. 
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ALTERNATIVE REPRESENTATIONS 
OF CLASSICAL FUNCTIONS 



Having characterized and classified the various types of fading channels 
and modulation/detection combinations that can be communicated over these 
channels, the next logical consideration is evaluation of the average error 
probability performance of the receivers of such signals. Before moving on in 
the next part of the book to a description of these receivers and the details of 
their performance on the generalized fading channel, we divert our attention 
to developing a set of mathematical tools that will unify and greatly simplify 
these evaluations. The key to such a unified approach is the development 
of alternative representations of two classical mathematical functions (i.e., 
the Gaussian g-function and the Marcum g-function) that characterize the 
error probability performance of digital signals communicated over the AWGN 
channel in a form that is analytically more desirable for the fading channel. 
The specific nature and properties of this desired form will become clear 
shortly. For the moment, suffice it to say that the canonical forms of the 
Gaussian and Marcum g-functions that have been around for many decades 
and to this day still dominate the literature dealing with error performance 
evaluation have an intrinsic value in their own right with respect to their 
relation to well-known probability distributions. What we aim to show, however, 
is that aside from this intrinsic value, these canonical forms suffer a major 
disadvantage in situations where the argument(s) of the functions depend on 
random parameters that require further statistical averaging. Such is the case 
when evaluating average error probability on the fading channel as well as on 
many other channels with random disturbances. Herein lies the most significant 
value of the alternative representations of these functions: namely, their ability 
to enable simple and in many cases closed-form evaluation of such statistical 
averages. 
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4.1 GAUSSIAN Q-FUNCTION 

4.1.1 One-Dimensional Case 

The one-dimensional Gaussian Q-function (often referred to as the Gaussian 
probability integral), Q(x), is defined as the complement (with respect to unity) 
of the cumulative distribution function (CDF) corresponding to the normalized 
(zero mean, unit variance) Gaussian random variable (RV) X. The canonical 
representation of this function is in the form of a semi-infinite integral of the 
corresponding probability density function (PDF), namely, 




In principle, the representation of (4.1) suffers from two disadvantages. From a 
computational standpoint, this relation requires truncation of the upper infinite 
limit when using numerical integral evaluation or algorithmic techniques. More 
important, however, the presence of the argument of the function as the lower 
limit of the integral poses analytical difficulties when this argument depends 
on other random parameters that ultimately require statistical averaging over 
their probability distributions. For the pure AWGN channel, only the first of the 
two disadvantages comes into play which ordinarily poses little difficulty and 
therefore accounts for the popularity of this form of the Gaussian Q-function 
in the performance evaluation literature. However, for channels perturbed by 
other disturbances, in particular the fading channel, the second disadvantage 
plays an important role since, as we shall see later, the argument of the Q- 
function depends, among other parameters, on the random fading amplitudes 
of the various received signal components. Thus, to evaluate the average error 
probability in the presence of fading, one must average the Q-function over the 
fading amplitude distributions. It is primarily this second disadvantage, namely, 
the inability to average analytically over one or more random variables when they 
appear in the lower limit of an integral, that serves as the primary motivation for 
seeking alternative representations of this and similar functions. Clearly, then, 
what would be more desirable in such evaluations would be to have a form for 
Q(x ) wherein the argument of the function is in neither the upper nor the lower 
limit of the integral and furthermore, appears in the integrand as the argument 
of an elementary function (e.g., an exponential). Still more desirable would be 
a form wherein the argument-independent limits are finite. In what follows, any 
function that has the two properties above will be said to be in the desired form. 

A number of years ago, Craig [1] cleverly showed that evaluation of the 
average probability of error for the two-dimensional AWGN channel could be 
considerably simplified by choosing the origin of coordinates for each decision 
region as that defined by the signal vector as opposed to using a fixed coordinate 
system origin for all decision regions derived from the received vector. This shift 
in vector space coordinate systems allowed the integrand of the two-dimensional 
integral describing the conditional (on the transmitted signal) probability of error 
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to be independent of the transmitted signal. A by-product of Craig’s work was 
a definite integral form for the Gaussian Q-function, which was in the desired 
form. 1 

In particular, Q(x ) of (4.1) could also now be defined (but only for x > 0) by 

<4 - 2) 

The form in (4.2) is not readily obtainable by a change of variables directly in 

(4.1) . However, by first extending (4.1) to two dimensions (x and y) where one 
of the dimensions (y) is integrated over the half plane, a change of variables from 
rectangular to polar coordinates readily produces (4.2). Furthermore, (4.2) can be 
obtained directly by a straightforward change of variables of a standard known 
integral involving Q(x), in particular [5, Eq. (3.363.2)]. Both of these techniques 
for arriving at (4.2) are described in Appendix 4A. Yet another derivation of 

(4.2) is given in Ref. 6 and is based on the fact that since the product of 
two independent random variables, one of which is a Rayleigh and the other 
a sinusoidal random process with random phase, is a Gaussian random variable, 
determining the CDF of this product variable is equivalent to evaluating the 
Gaussian g-function. 

Based on our previous discussion, it is clear that Q(x) of (4.2) is in the 
desired form, that is, in addition to the advantage of having finite integration 
limits independent of the argument of the function, x, it has the further advantage 
that the integrand now has a Gaussian form with respect to x! We shall see in 
Chapter 5 that this exponential dependence of the integrand on the argument of 
the Q-function will play a very important role in simplifying the evaluation 
of performance results for coherent communication over generalized fading 
channels. Before exploiting this property of (4.2) in great detail, however, we wish 
to give further insight into the alternative definition of the Gaussian Q-function 
with regard to how it relates to the well-known Chernoff bound. 

Note that the maximum of the integrand in (4.2) occurs when 9 = n/2. [i.e., 
the integrand achieves its maximum value, namely, exp(— x 2 /2), at the upper 
limit]. Thus, replacing the integrand by its maximum value, we immediately 
get the well-known upper bound on Q(x), namely, Q(x) < \ exp(— jc 2 /2), which 
is the Chernoff bound. As we shall see on many occasions later in the book, 
the advantage of this observation is that the form of Q(x) in (4.2) allows 
manipulations akin to those afforded by the Chernoff bound but without the 
necessity of invoking a bound! In principle, one simply operates on the integrand 
in the same fashion as if the ^-function had been replaced by the Chernoff 
bound, and then at the end performs a single integration over the variable 9. For 

1 This form of the Gaussian Q-function was earlier implied in the work of Pawula et al. [2] and 
Weinstein [3]. The earliest reference to this form of the Gaussian Q-function found by the authors 

appeared in a classified report (which has since become unclassified) by Nuttall [4]. The relation given 
there is actually for the complementary error function, which is related to the Gaussian Q-function 
by erfc(;t) = 2Q(j2x). 
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example, many problems dealing with sequence detection whose error probability 
performance was heretofore characterized by a combined union -Chemoff bound 
can now be described by just a union bound, thereby improving its tightness. 
This behavior is discussed in more detail in Chapter 12. 



4.1.2 Two-Dimensional Case 

The normalized two-dimensional Gaussian probability integral is defined by 

Q(X\, y\-, p) = - — } = ( f exp ~^ 7 T 7 ^\dxdy (4.3) 

2nsJ\ - p 2 J Xl J y, L 2(1 - p 2 ) J 



Rewriting (4.3) as 
Q(x i, yup) = - — - 



Xjfjf 



(x +Xi) 2 + (y + yi) 2 - 2p(x +Xi)(y + yi)1 



we see that we can interpret this double integral as the probability that a signal 
vector s = (—X\ , — >'i ) received in correlated unit variance Gaussian noise falls 
in the upper right quadrant of the ( x , y) plane. Defining 



then using the geometry of Fig. 4.1, it is straightforward to show that Q(x \ , yi ; p) 
can be expressed as 



i r> 2 -^ - 

Q{xi,yu P ) = — r 

2n Jo 1 - p su 

i [+■ Vi 
2n J 0 1 - f. 



sin 20 
~ P 2 



S 1 — p sin 29 cos 2 <j> s 
_ 2" (1 - p 2 ) sin 2 9 



- p sin 29 

which using (4.6) simplifies still further to 



Q{x\,yuP) 



1 r”/*-'™ 1 .n /-n ^J\ _ p 2 



= ~[ 
2n Jo 



1 r tan ’ y ' ,Xl \J\- p 1 y 2 1 - p si 

" 2n Jo 1 - p sin 29 CXP 2(1- p 2 ) 



x\ 1 — p sin 29 
2(1 — p 2 ) sin 2 9 

y\ 1 — p sin 20 1 
sin 2 9 ' 
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Ne i& =(x+x^ )+y (y+y-i ) 

(*+*i ) 2 +(y+y 1 ) 2 -2/o(jh-jc, )(y+^ )=A/ 2 (1 -psin20) 




A/^Cx+xO+yXy+y,) 

(*+*i ) 2 +(y+y, ) s -2p(x+x 1 )(y+y 1 ) =/V 2 (1 -p sin 28) 




For the special case of p = 0, (4.7) simplifies to 

G(*i, 3fi;0) = Q(xi)Q(yi) 




In addition, when x\ = y\ = x, we have 

1 Z 1 ^ 4 / x 2 \ 

Q(x,r,0)=Q(x)=-l 



(4.9) 
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which is a single-integral form for the square of the Gaussian ^-function. 2 The 
form of the result in (4.9) can also be obtained directly from (4.1) by squaring 
the latter, rewriting it as a double integral of a two-dimensional Gaussian PDF, 
and then converting from rectangular to polar coordinates (see Appendix 4A). 
Comparing (4.9) with (4.2), we see that to compute the square of the one- 
dimensional Gaussian probability integral, one integrates the same integrand but 
only over the first half of the domain. 



4.2 MARCUM Q-FUNCTION 

Motivated by the form of the alternative Gaussian (9-function in (4.2), one 
questions whether a similar form is possible for the generalized Marcum Q- 
function [8], which as we shall see in later chapters is common in performance 
results for communication problems dealing with partially coherent, differentially 
coherent, and noncoherent detection. We now present the steps leading up to this 
desirable form and then show how it offers the same advantages as the alternative 
representation of the Gaussian (9-function. For simplicity of the presentation, 
we shall first demonstrate the approach for the first-order (m = 1) Marcum Q- 
function and then generalize to the mth-order function, where in general m can 
be noninteger as well as integer. The derivations and specific forms that will 
be derived can be found in Ref. 9, with similar derivations and forms found 
in Ref. 10. 



4.2.1 First-Order Marcum Q-Function 

The first-order Marcum Q-function, Q\ (s', «/y), is defined as the complement 
(with respect to unity) of the CDF corresponding to the normalized noncentral chi- 
square random variable, Y = Ya=i whose canonical representation is in the 
form of a semi-infinite integral of the corresponding probability density function 
(PDF), namely, 3 



QiG\ Vj) = - vex P * 2 S ) /() ^ dx ( 4 -!0) 

where s 2 is referred to as the noncentrality parameter. Also, for simplicity 
of notation, we shall replace the arguments s and */y in (4.10) by a and /3, 



2 This result can also be obtained from Lebedev [7, Chap 2, Prob. 6] after making the change of 
variables 9 = it/2 — tan -1 1. 

3 It is common in the literature to omit the “1” subscript on the Marcum Q-function when referring 

to the first-order function. For the purpose of clarity and distinction from the generalized (mth-order) 

Marcum Q-function to be introduced shortly, we shall maintain the subscript notation. 
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respectively, in which case (4.10) is rewritten in the more common form 4 



= |“, exp (_l±iL) 



Using integration by parts, it has also been shown [12,13] that the first-order 
Marcum Q-function has the series form 



fit (a. P) = ex P ( ^ ) £ (j) 

= exp [-^(1 + £ 2 )] (4-12) 



where £ = a/ fi. The reason for introducing the parameter £ to represent the ratio 
of the arguments of the Marcum ^-function is in the same sense that the definition 
in (4.10) has one argument that represents the true argument of the function (i.e., 
^/y), whereas the second argument (i.e., s) is a parameter. More insight into the 
significance of £ in the digital communications application and its dependence 
on the modulation/detection form is given in Chapter 5. Suffice it to say at the 
moment that in terms of the analogy with Craig’s result, we are attempting to 
express the Marcum Q-function as an integral with finite limits and an integrand 
that is a Gaussian function of fi. 



4 It is interesting to note that the complement (with respect to unity) of the first-order Marcum Q- 
function can be looked upon as a special case of the incomplete Toronto function [1 1, pp. 227-228], 
which finds its roots in the radar literature and is defined by 



T B (m , , 



= 2r"- m+1 e - r2 



J t m ~ n e~ ,2 I n (2rt) dt. 



In particular, we have 



T ’A uo -i) 



— Gt («, j8). 



Furthermore, as fi — * oo, Qi (a, fi) can be related to the Gaussian Q-function as follows. Using the 
asymptotic (for large argument) form of the zero-order modified Bessel function of the first kind, 
we get [4, Eq. (A-27)] 



Gi(«, 
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The modified Bessel function of kth order can be expressed as the integral 
[5, Eqs. (8.406.3) and (8.411.1)] 

h(z) = ^f (-je- ie ) k e- zsiae dQ (4.13) 

where j = \f—l and it is clear that the imaginary part of the right-hand side of 
(4.13) must be equal to zero [since h(z) is a real function of the real argument 
z]. Although (4.13) is not restricted to values of £ less than unity, to arrive at the 
alternative representation of the Marcum g-function it will be convenient to make 
this assumption. (Shortly we shall give an alternative series form from which an 
alternative representation can be derived for the case where the ratio a/p is 
greater than unity.) Thus, assuming in (4.13) that 0 < f < 1, after substitution in 
(4.12) we obtain 



Qi(a, P) = exp 



= exp 



[-y(l + £ 2 )] ^ j n _Y^<<-je- je )] k e- pl ^ e d6 

[-?' :1 + « 2) ] h L TTh^f*** <4 14> 



Simplifying the complex factor of the integrand as 

1 1 1 + £(sin 9 — j cos 9) 

1 + SUe~ je ) = 1-K(sin<9 + ./cos (9) = (1 + £ sin<9) 2 + (fcos<9) 2 
_ 1 + £(sind - j cos 9) 

1 + 2£ sin 9 + i/p 



and recognizing again that the imaginary part of (4.15) must result in a zero 
integral [since Q\(a, p) is real], substituting (4.15) into (4.14) gives the final 
result 



Gi(«, P) = om, P) = 



hi: 



1 + f sin 9 

l + 2£sin(9-K 2 



x exp | - ^-(l + 2^sin6> + f 2 )| d9, P > a > 0 (0<f<l) 

(4.16) 

which is in the desired form of a single integral with finite limits and an integrand 
that is bounded and well behaved over the interval — n < 9 < n and is Gaussian 
in the argument p. 

We observe from (4.16) that f is restricted to be less than unity (i.e., a / P). 
The reason for this stems from the closed form used for the geometric series 
in (4.14), which, strictly speaking, is valid only when £ < 1. This special case, 
which has limited interest in communication performance applications, has been 
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evaluated [14, Eq. (A-3-2)] and has the closed-form result 
1 + exp(-a 2 )/ 0 (a 2 ) 

Q i (a, «) = (4.17) 

For the case a > /S > 0, the appropriate series form is [12, 13] 5 
fit («. = 1 - exp E (£)*'*(«/») 

= 1 - exp [-y(l + £ 2 )] (4.18) 



whereupon an analogous development to that leading up to (4.16) would yield 
the result 6 



fit (a, P) = fit (of, <*?)=! + 



hL 



f 2 + £ sin 6 
1 + 2£sin6>-K 2 



x exp [— ^-(1 + 2£sin0 + f 2 )j dO, a>/3>0 (0 < f < I ) 

(4.19) 

where now £ = f}/a < 1. Once again the expression in (4.19) is a single integral 
with finite limits and an integrand that is bounded and well behaved over the 
interval —n < 6 < it and is Gaussian in one of the arguments, in this case, 
a. Aside from its analytical desirability in the applications discussed in later 
chapters, the form of (4.16) and (4.19) is also computationally desirable relative 
to other methods suggested previously by Pari [16] and Cantrell and Ojha [17] 
for numerical evaluation of the Marcum O-function. 

The results in (4.16) and (4.19) can be put in a form with a more 
reduced integration interval. In particular, using the symmetry properties of 
the trigonometric functions over the intervals (—it, 0) and (0, it), we obtain the 
alternative forms 



Gi (of, P)=Qm> 



i -r 

tt Jo 



1 ± £ cos 0 
1 ± 2£ cos 9 + i) 2 



6 > a > 0 ( 0 <£< 1 ) 

(4.20) 



5 We note that (4.18) is valid even if a < fi, but for our purpose the series form given in (4.12) is 

6 At first glance it might appear from (4.19) that the Marcum (2-function can exceed unity. However, 
the integral in (4.19) is always less than or equal to zero. It should also be noted that the results 
in (4.16) and (4.19) can also be obtained from the work of Pawula [15] dealing with the relation 
between the Rice /e-function and the Marcum Q-function. In particular, equating Eqs. (2a) and 
(2c) of Ref. 15 and using the integral representation of the zero-order Bessel function obtained from 
(4.13) with k = 0 in the latter of the two equations, one can, with an appropriate change of variables, 
arrive at (4.16) and (4.19). 
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and 



0 i (a. P) = 01 (a. <*£) 



= > + if 

IT Jo 



f 2 ± f COS 0 

l±2£cos<9 + £ 2 



x exp ± 2£cos6> + f 2 )J dO, u>fi>0 (0 < £ < 1) 

(4.21) 

Since, as we shall soon see, for the generalized (mth-order) Marcum 0-function 
the reduced integration interval form is considerably more complex than the form 
between symmetrical (—it, it) limits, we shall tend to use (4.16) and (4.19) when 
dealing with the applications. 

As a simple check on the validity of (4.16) and (4.19), we examine the limiting 
cases 0i(O, ff) and Qi(a, 0). Letting £ = 0 in (4.16), we immediately have the 
well-known result 

0,(0, P) = exp (-2^ (4.22) 



Similarly, letting £ = 0 in (4.19) gives 

0i (a, 0) = 1 (4.23) 



Simple upper and lower bounds on 0| (a. f J >) can be obtained in the same 
manner that the Chernoff bound on the Gaussian 0-function was obtained from 
(4.2). In particular, for ft > a > 0, we observe that the maximum and minimum 
of the integrand in (4.16) occurs for 0 = —n/2 and 0 = n/2, respectively. Thus, 
replacing the integrand by its maximum and minimum values leads to the upper 
and lower “Chemoff-type” bounds 



£ 2 (l+f) 2 l 



i + f L 

r equivalently, 



which, in view of (4.22), are asymptotically tight as a — > 0. 

For a > f3 > 0, the integrand in (4.19) has a minimum at 6 = —n/2 
and a maximum at 9 = n/2. Since the maximum of the integrand, [f/(l + 
£)] exp[— a 2 (l + f) 2 / 2], is always positive, the upper bound obtained by replacing 
the integrand by this value would exceed unity and hence be useless. On the other 
hand, the minimum of the integrand, — [f/(l — £)] exp[— a 2 (l — f) 2 /2] is always 
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negative. Hence a lower Chemoff-type bound on Q\ (a, P) is given by 7 



1 - exp [- 01 (1 2 ^ j < Qi{a, at,) (4.25a) 

or equivalently, 

1 - exp [- ^ 'P> j < Q^ a (4.25 b) 



Another alternative and in some sense simpler form of the first-order Marcum 
^-function was recently disclosed in Ref. 18. This form dispenses with the 
trigonometric factor that precedes the exponential in the integrands of (4.16) 
and (4.19) in favor of the sum of two purely exponential integrands each still 
having the desired dependence on p or a as appropriate. In particular, with a 
change in notation suitable to that used previously in this chapter, the results 
obtained in Ref. 18 can be expressed as follows: 



Qi(a, p) = Qi(PZ, P) = ^f {^P [-yd + 2£ sin 0 + £ 2 ) 
(i - r 



+ ex P — hr 



in # + £ 2 / J J 



dQ, 



> a > 0 (0 < £ < 1) 

(4.26) 



2 \ 1 + 2£ sin 

Qi(oc,P) = Qi(a,a£) = 1 + J {exp [-y (1 + 2£sin6> + £ 2 )J 

- exp [~f ( i+^+f )]}* <0 - < - 1) 



or equivalently, in the reduced forms analogous to (4.20) and (4.21): 



gi(«, P) = Qi(PZ, P) = ^ £ {exp [— y(l ± 2 £cos 9 + £ 2 )] 

+ exp [~T( l±yci9 + ^- )]}‘ ift <0 - < - 1) 

(4.28) 

Gi(«, P) = Qi(a, a£) = 1 + {exp [—y(l ± 2£cos0 + £ 2 )] 



a 2 / (1 - £ 2 ) 2 \ 

" 2 Vl±2£cosi9-K 2 y 



>P> 0 (0 < £ < 1) 
(4.29) 



7 Clearly, since Q\ (a, fl) can never be negative, the lower bound of (4.25a) or (4.25b) is only useful 
for values of the arguments that result in a nonnegative value. 
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Since the first exponential integrand in each of (4.26) through (4.29) is identical 
to the exponential integrand in the corresponding equations (4.16), (4.19), (4.20), 
and (4.21), we can look upon the second exponential in the integrands of the 
former group of equations as compensating for the lack of the trigonometric 
multiplying factor in the integrands of the latter equation group. 

The forms of the Marcum Q-function in (4.26) and (4.27) [or (4.28) and (4.29)] 
immediately allow obtaining tighter upper and lower bounds of this function than 
those in (4.24) and (4.25). In particular, once again recognizing that for p > a > 0 
the maximum and minimum of the first exponential integrand in (4.26) occurs for 
0 = — 7r/2 and 0 = 7r/2, respectively, and vice versa for the second exponential 
integrand, we immediately obtain 8 



£ 2 (l+f) 2 ' 



< Qi(PS, P) < exp -■ 



£ 2 (l-f) 2 l 



or equivalently, 



< Q\ia, P) < exp 



(4.30a) 



(4.306) 



Making a similar recognition in (4.27), then for a > /3 > 0 we obtain the lower 
bound 

1 - I {exp - exp [-^!^] } 5 2 , («, «{) (4.31a) 

or equivalently, 9 

1 “ \ { 6XP [~ (a 2^ ] “ 6XP } - ei( “’ ^ (4.316) 



8 It has been pointed out to the authors by W. F. McGee of Ottawa, Canada that the same tighter 
bounds can be obtained from (4.16) by upper and lower bounding only the exponential factor in 
the integrand (thus making it independent of the integration variable 0) and then recognizing that 
the integral of the remaining factor of the integrand can be obtained in closed form and evaluates 
to unity. We point out to the reader that this procedure of only upper and lower bounding the 
exponential is valid when the remaining factor is positive over the entire domain of the integral as 
is the case in (4.16). 

9 Note that the upper bound in this case would become 

fit («. + \ jexp |~ (t * ^ j - exp j^_ (a! + ^ ) j j 



which exceeds unity and is thus not useful. 
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We note that the bounds in (4.31a) and (4.3 1 b) cannot be obtained directly from 
(4.19) by lower bounding the exponential in the integrand since the factor that 
precedes it is not positive over the entire domain of the integral. We also note 
that although tighter bounds on the first-order Marcum g-function have recently 
been obtained by Chiani [19], they are not in the desired form and thus are not 
helpful in applying the MGF-based approach to upper bound the average BEP 
performance of noncoherent and differentially coherent communication systems 
perturbed by slow fading. 

Before concluding this section, we alert the reader to the inclusion of the 
endpoint a = ft (f = 1 ) in the alternative representations of (4.26) through 
(4.29), all of which yield the value of Qi(a, a) in (4.17). This is in contrast 
to the alternative representation pairs (4.16), (4.19) or (4.20), (4.21), which yield 
different limits as a approaches yd (£ approaches 1) from the left and right, respec- 
tively. The reason for these different left and right limits [the arithmetic average 
of which does in fact produce the result in (4.17)] is again tied to the fact that 
these representations rely on the convergence of a geometric series which, strictly 
speaking, is not convergent at the point f = 1. On the other hand, the derivation of 
the representations in (4.26) through (4.29) is based on a different approach [18] 
and as such are continuous across the point £ = 1 . Thus, even in the neighborhood 
of £ = 1, one would anticipate better behavior from these representations. 

4.2.2 Generalized (mth-Order) Marcum Q-Function 

The generalized Marcum g- function is defined analogous to (4.10) by 

Qm(s, *Jy) = x m exp ^ S j l m -\(sx)dx (4.32) 

or, equivalently, 10 

10 The complement of the generalized Marcum Q-function can also be viewed as a special case of 
the incomplete Toronto function. In particular, 

5 ( 2 m-l,m-l,^) = l- Q m (a, ft 

Furthermore, as fi — » oo, Q m (a, ft can be related to the Gaussian Q-function in the same manner 
as was done for the first-order Marcum Q-function. Specifically, since the asymptotic (for large 
argument) form of the fcth-order modified Bessel function of the first kind is independent of the 
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1 ( x 2 + a 2 \ 

Q m (a, P) = x "‘ ex P y 2 — ) dx ( 4 - 33 ) 

where for m integer, the canonical form in (4.32) has the significance of 
being the complement (with respect to unity) of the CDF corresponding to the 
normalized noncentral chi-square random variable, Y = J2'k=i ^ would be 
desirable to obtain integral forms analogous to (4.16) and (4.19) to represent the 
generalized Marcum g-function regardless of whether m is integer or noninteger. 
Unfortunately, this has been shown to be possible only for the case of m integer, 
at least in the sense of an exact representation [9,10]. As we shall see from 
the derivation of these forms, however, the ones derived for m integer are also 
applicable in an approximate sense to the case of m noninteger in certain regions 
of the function’s arguments. Thus, we begin by proceeding with an approach 
analogous to that taken in arriving at (4.16) and (4.19) without restricting m to 
be integer, applying this restriction only when it becomes necessary. The details 
are as follows. 

Applying integration by parts to (4.33) with u = x m ~ l I m -\(ax) and dv = 
x exp[— (x 2 + a 2 )/2] dx and using the Bessel function recursion relation 
I m -\(x) — I m+ 1 (x) = (2m/x)I m (x) [20, Eq. (9.6.26)], it is straightforward to show 
that the generalized Marcum g-function satisfies the recursion relation 

Q m (a,p)=(^j + (4.34) 

Recognizing that regardless of the values of a and p, Q-oo(oe, P) = 0 and 
goo (a, >8) = 1, then iterating (4.34) in both the forward and backward directions 
gives the series forms 



Q m (a, /3) = exp^- a ^ ^ ^ I- r (aP) (4.35) 

and 

Q,„ia, P) = 1 - exp J2 IAap) (4.36) 

Note that when m is integer, the values of the summation index r are also integer, 
and since in this case I- r (x ) = I r {x), we can rewrite (4.35) as 

Qm(ot, p) = exp (^- a ^ I riot P) (4.37) 

Equations (4.36) and (4.37) are the series forms of the generalized Marcum g- 
function that are found in the literature and apply when m is integer. When m is 
noninteger, the values of the summation index r are also noninteger, and since 
in this case 7_ r (x) / I r (x), then (4.37) is no longer valid; instead one must use 




MARCUM Q- FUNCTION 83 



(4.35) . Note that (4.36) is valid for m integer or m noninteger and together with 
(4.37) reduce to (4.18) and (4.12), respectively, for m = 1. 

Although the discussion above appears to make a mute point, it is important 
in the approach taken in Ref. 9 since certain trigonometric manipulations 
applied there when deriving the alternative representation of the Marcum 
Q-function from the series representation hold only for m integer. Despite 
this fact, however, if the I r (x) function could still be represented exactly 
by the integral I r {x)= ( I /lit) f* n (— je~ j0 ) r e~ xsme d0 [which is the same as 
(4.13) with r substituted for k\, then even though the summation indices in 

(4.36) and (4.37) are noninteger, adjacent values are separated by unity and 
the same geometric series manipulations could be performed as were done 
previously for the first-order Marcum 2-function. Unfortunately, however, the 
integral representation of I r (x ) above is approximately valid only when its 
argument x is large irrespective of the value of r, and thus the steps that 
follow and the results that ensue are only approximate when m, the order 
of the Marcum 2-function, is noninteger. In what follows, however, we shall 
proceed as though this integral representation is exact (which it is for r 
integer, or equivalently, m integer) with the understanding that the final integral 
representations obtained for the mth-order Marcum 2-function will be exact for m 
integer and approximate (for large values of the argument or a as appropriate) 
for m noninteger. 

As discussed previously with regard to the application of the alternative 
representation, it is convenient to introduce the parameter £ < 1 to represent the 
ratio of the smaller to the larger of the two variables of the Marcum 2-function. 
We can therefore rewrite (4.35) and (4.36) as 

QrnW, P) = exp [-y(l + £ 2 )] £ £ r /_ r 06 2 £), 0+ < £ = a/p < 1 (4.38) 

Q,„(a, «£)=!- exp [-y (1 + £ 2 )] f] £'7 r (<* 2 £), 0<£ = /S/a < I (4.39) 



Letting N < m < N + 1 (i.e., N is the largest integer less than or equal to m), 
substituting the integral form of the modified Bessel function in (4.38) gives 

QmifiK, P) = exp [—y(l + £ 2 )] ^ E K r {-je- je )- r e~^ M d6 

= exp [-^(1 + £ 2 )] E £ | {e m^y 

+ jr (e j(e+7c/2 ^y] e -^ sine dd (4.40) 
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Recognizing as mentioned above that the sums in (4.40) are still geometric series 
despite the fact that the summation index r does not take on integer values, we 
obtain 



Qm(ft,P) = ex P -^(1 + r) 



</ih- 



1 _ t N JN(8+7t/ 2) 

-Km- 1 KO+jt/ 2) 1 ^ g 

1 _ £ e j(9+jr/2) 



fN+l-mJ(N+l-m)(e+ir/2) _ 



1 

1 _ £ e K8+n/ 2) 



e ~p tsme^Q (4.41) 



Since Q m (ot, P) is a real function of its arguments, then taking the real part of 
the right hand side of (4.41) and simplifying results in the desired expression 



„ m 1 T r (m_1) {cos[(m - 1 ){9 + ;r/2)] - i;cos[m(9 + n/ 2)]} 

^ 1+24 sin + ^ 

x exp | — 4.(1 + 2%sm$ + ^)j d&, 0 + < < = a/ji < (4.42) 



Note that the limit of Q m (K, P) as f -> 0 is difficult to evaluate directly from the 
form in (4.42), which explains the restriction on its region of validity. However, 
this limit can be evaluated starting with the integral form of (4.33) and using the 
small argument form of the modified Bessel function, that is, 



h(z) - 



C z/2) v 

r(v + 1) 



When this is done, the following results: 



Q m ( 0, P) = 



r (w, p 2 /2) 
r (m) 



(4.43) 



(4.44) 



where T(a, x) is the complementary Gauss incomplete gamma function [5, 
Eq. (8.350.2)]. Using a particular integral representation of T(a, x) [21, 
Eq. (11.10)], then after some changes of variables, Q m ( 0, p) can be put in the 
desired form, 



(4.45) 



For m integer, the gamma function can be evaluated in closed form [5, 
Eq. (8.352.2)] and (4.44) reduces to 
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e .<o,«=i> P (4)«^ 



which is a special case of another form of the Marcum ^-function proposed by 
Dillard [22], namely, 



<?2\ 



a .(„.« = fe xp (4)<^’ + f , exp(- 

n = 0 \ Z / n - k=0 V 

In a similar fashion, substituting the integral form of the modified Bessel 
function in (4.39) gives 

Q m (a, a® = 1 - exp [-y(l + £ 2 )] £ £ 

= i - exp [-^(i + ? 2 )] ^ 



where upon recognizing the sum as a geometric series, we get 



-FSsme dQ 

(4.48) 



Q m (a, o£) = 1 - exp (1 + C) — 



1 _ £ e j(8+n/2) 



e -p 2 £sin8 d Q (4 49) 



Finally, taking the real part of the right-hand side of (4.49) and simplifying gives 
the complementary expression to (4.42), namely, 



</lh 

real part of 
f expressior 

^ „ , 1 r{cos[m(0 + ff/2)]-{cos[(m-l)(e + ff/2>i} 

Gm («, «?)=!-- £ l + gsing + g* 

x exp |-^-(l + 2? sin# + f 2 )j dO, 0 < £ = /8/a < 1 (4.50) 

For m integer, (4.42) and (4.50) simplify slightly to 

1 [* (_i >/ 2 £-(m- 1 )| CO s (w - 1)6» + f sinm<9] 



QmW, P) 



2n J- n 1 4 
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n tny - 1 r (~l) m/2 ^ (m ^[sinCm— 1)0 — £ cos md] 

Qm (fit, P) J x | + 2 £ sin (9 + £ 2 

x exp |— ^-(1 + 2£sin# + f 2 )J 0 + < f = a/j8 < 1, m even 

^ N , , -1 f* (— 1 ) <m-,)/2 f m |sin mO + £ cos(m - 1)0] 

e,„( a , ?«) = ! + - 1 + 2gsine+ ^ 

x exp ^-(1 + 2£sin# + f 2 )J d6, 0 < £ = P/a <1, m odd 

(4.52) 

_ 1 r n (-l) m / 2 £ m [cosrn6>-fsin(rn- 1)0] 

W “ 2tt ./ I + 2£sin0 + £ 2 

x exp ^-(1 + 2£sin0 + f 2 )J dO, 0 < f = P/a <1, m even 

which are the forms reported by Simon [9, Eqs. (8) and (10)]. Finally, the limit 
of (4.50) as £ -> 0 is easily seen to be Q m (a, 0) = 1, which is in agreement with 
the similar result in (4.23) for the first-order Marcum g-function. 

As before, we observe from (4.42) and (4.50) that / is restricted to be less than 
unity (i.e., a / /i) for the reason mentioned previously relative to the alternative 
representations of the first-order Marcum g-function. For m integer, this special 
case has the closed-form result [10] 

Q m (a, a) = ^ + exp(—a 2 ) \h^l + ^ 7*(or 2 )j (4.53) 

For m noninteger, the authors have been unable to arrive at an approximate 
closed-form result. 

Finally, we note that the approach taken in Ref. 18 for arriving at the 
alternative forms for the first-order Marcum 0- function given in (4.26) through 
(4.29) unfortunately does not produce an equivalent simplification in the case of 
the mth-order Marcum g-function. Similarity, upper and lower bounds on the 
mth-order Marcum g-function are not readily obtainable by upper and lower 
bounding the exponential in the integrands of (4.42) and (4.50) since the first 
factor of these integrands is not positive over the domain of the integral. Thus, 
throughout the remainder of the book, unless the forms in (4.26) through (4.29) 
produce a specific analytical advantage, we shall tend to use the alternative forms 
of the first-order Marcum g-function function given in (4.16) and (4.19) because 
of their synergy with the equivalent forms in (4.42) and (4.50) for the mth-order 
Marcum g-function. 

Despite the fact that upper and lower bounds on the mth-order Marcum g- 
function are not readily obtainable from (4.42) and (4.50), it is nevertheless 
possible [23] for m integer to obtain such bounds by using the upper and 
lower bounds on the first-order Marcum g-function given in (4.30a) and (4.30&) 
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together with the recursive relation of (4.34). 11 In particular, (4.34) can first be 
rewritten as 



Qrn(«, ft) = exp a 2 p ) J2 (0 In(*P) + Q\(*,P) (4.54) 

Now expressing I„(z) in its integral form analogous to (4.13), that is, 

I n (z)=- [ e zcose eos nOdO (4.55) 

zz Jo 

and recognizing that the exponential part of the integrand has maximum and 
minimum values of e z and e~ z , respectively, then because of the n-fold peri- 
odicity of cos nQ and the equally spaced (by n/n) regions where cos nO is 
alternately positive and negative within the interval 0 < 0 < n, we can upper 
bound I n (z ) by 12 

n ( l f*l 2n 1 [W 2 " 1 f 2 */ n \ 

I n (z) < - [e z — / cos n0dd + e z — / cos n0d6 + e z — / cosnOdO) 

2 \ T Jo Zt J n/2n Zt J 2n/2n ) 

= 6 ~ 6 , z > 0 (4.56) 

71 



which is independent of n for n > 1. This allows the series in (4.54) to be 
summed as a geometric series that has a closed-form result. Finally, using (4.56) 
in (4.54) together with the upper bound on Q\ (a, f$) for 0 + < £ = a/ ft < 1 as 
given by (4.30b), we obtain after some manipulation 



^ ^ r 03-a) 2 l If G6-a) 2 l 

Qm(a,ft)<exp + — s exp 



r 06 + a) 2 i) (ft\ m ~ l 


1 -(a/ftr~ ] l 


[ 2 J/U; 


. 1-01/ ft \ 



(4.57a) 



r equivalently, 



QmiftS, P) < exp I- 



|g 2 (l-C) 2 ] , 1 ; 
2 J zt * 
/5 2 (1+C) 2 1 



l 2 (W) 2 l 



1 /i-r-'\ 



1 1 We emphasize that we are again looking for simple (exponential-type) bounds recognizing that 
although these may not be the tightest bounds achievable over all ranges of their arguments, relative 
to others previously reported in the literature [23], they are particularly useful in the context of 
evaluating error probability performance over fading channels. 

12 Note that (4.56) is valid for n odd as well as n even. 
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The first term of (4.57a) or {A. 51b) represents the upper bound on the first-order 
Marcum g-function, and thus, as would be expected, for m = 1 the remaining 
terms in these equations evaluate to zero. 

To obtain the lower bound on Q m (a, f$) for 0 + < f = a/ fi < 1, we can again 
use the lower bound on gi (a, fi) as given by (4.30 b) in (4.54); however, the 
procedure used to obtain the upper bound on /„ (z.) that led to (4.56) would now 
yield the lower bound 

f n (z) > 5 - (4.58) 

7t 

which for z > 0 is always less than or equal to zero and therefore not useful 
relative to the simpler lower bound I n (z) > 0, n > 1 . Thus, to get a useful lower 
bound on I n (z), we must employ an alternative form of its integral definition, 
namely [20, Eq. (9.6.18)] 

In(z) = k/ 2) " T eZ cose sin 2„ ede (4 .5 9) 

y/TtT[n + 2 ) Jo 

Once again replacing the exponential factor of the integrand by its minimum 
value, e~ z , we obtain the lower bound 

I n (z)> | , I sin 2 " Odd (4.60) 

y/7t l[n + 2 ) Jo 

which using [5, Eqs. (3.621.3) and (8.339.2)] yields 



' (2 u)!! 



(4.61) 



Finally, substituting (4.61) in (4.54) and using the lower bound on Qi(a, Ji) as 
given by (4.30ft) results after some simplification in 



ifi + af 






or equivalently, 



1 ^ ^ 0 < ? = a/p < 1 (4.63) 



Again the first term (corresponding to n = 0) is the lower bound on the first- 
order Marcum g-function, and as would be expected, for m = 1 there are no 
other terms in the sum. Also, for f = 0, (4.63) becomes equal to the exact result 
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for Q m (0, p) as given by (4.46). Thus one would anticipate that the lower bound 
would be asymptotically tight for small values of 4- 

For the parameter range 0 < £ = P/a < 1, we can obtain a lower bound on 
Q m (a, P) by using the lower bound on the first-order Marcum g-function as 
in (4.31&) together with the lower bound on I n (z) as given by (4.61), which 
results in 




+ exp 



(a-p ) 2 1 



jct + P) 2 



]} 






(4.64a) 



or equivalently, 



a 2 (W) 2 ] 



« 2 (1 + ?) 2 



]} 



aTWFl g (0<V/2r 5 &(a a() 



(4.64 b) 



Figures 4.2, 4.3, and 4.4 are plots of Q\(a, P), Qi{a, p), and Qiia, P) versus P 
together with their upper and lower bounds, as determined from (4.57a) and (4.62) 
for values of a = 1,5, and 10, respectively. Also illustrated are Chernoff-type 
upper and lower bounds derived from Ref. 23. 13 We observe that as anticipated 
the upper bound of (4.57a), corresponding to P > a is asymptotically tight, 
whereas for the same region, the lower bound as given by (4.62) is quite loose and 
gets looser as a/P increases. Fortunately (we shall see why in later chapters), the 
reverse is true for the lower bound of (4.64a), corresponding to the region a > P 
(i.e., it is always extremely tight). In the case of (4.64a), the lower bound was 
examined both with and without the additional term involving the summation, 
the latter being equivalent to (4.3 \b). Over the range of values considered, the 
numerical results that take into account the presence of the extra series term are 
indistinguishable (when plotted) from those without it. Hence we can conclude 
that this series term can be dropped without losing tightness on the overall result. 
This observation will be important in the application discussions that follow in 
later chapters. 



13 It is to be noted that whereas these upper and lower bounds of Ref. 24 are of interest on their own, 
their regions of validity do not share a common boundary in the a versus f) plane, thus prohibiting 
their use in evaluating upper bounds on expressions containing the difference of two Marcum Q- 
functions with reversed arguments [i.e., Q ln (a, ft) — Q m (f>, a)]. We shall see later in the book that 
expressions of this type are characteristic of many types of error probability evaluations over fading 
channels, and thus upper bounding such error probabilities requires an upper bound on the first 
(2-function and a lower bound on the second, with a boundary between their regions of validity 
given by a = f). The bounds presented in this chapter clearly satisfy this requirement, and thus with 
regard to the primary subject matter of this book, they are the only bounds of interest. 
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Exponential Bounds on the First Order Marcum Q-function 




123456789 10 

ft 



Exponential Bounds on the Second Order Marcum O-function 




Exponential Bounds on the Fourth Order Marcum Q-function 




Figure 4.2. Plots of Qi (1 , /3), 02(1, ft), 04(1, /S), and their bounds versus Exact; *, upper 
bound (4.57a); x, Chernoff upper bound from Ref. 23; *, Chernoff lower bound from Ref. 23; 
A, lower bound of (4.62). 



4.3 OTHER FUNCTIONS 

Before going on to discuss how these alternative representations of the 
Gaussian and Marcum g-functions allow for unification and simplification of 
the evaluation of average error probability performance of digital communication 
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Exponential Bounds on the First Order Marcum Q-function 







Exponential Bounds on the Second Order Marcum Q-function 




0 2 4 6 8 10 12 14 16 18 20 

P 

Figure 4.3. Plots of Qi (5, P), Q2(5, p), Q4(5, p), and their bounds versus p. Exact; *, upper 
bound of (4.57a); x , Chernoff upper bound from Ref. 23; *, Chernoff lower bound from Ref. 23; 
A, lower bound of (4.62). 

over generalized fading channels, we consider alternative representations of yet 
two other functions that can be derived from the results above and are also of 
interest in characterizing this performance. 

One function that occurs in the error probability analysis of conventional 
noncoherent communication systems and also in certain differentially and 




Q 4 ( 1°,/3) Q 2 (10,/3) Qi(10,/3) 
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Exponential Bounds on the First Order Marcum O-function 






Figure 4.4. Plots of Qi (1 0, y3), Q2(10,/3), 04(10, P), and their bounds versus fi. -.Exact; 
*, upper bound of (4.57a); x, Chernoff upper bound from Ref. 23; *, Chernoff lower bound 
from Ref. 23; A lower bound of (4.62). Note that the lower bound given by (4.62) and the 
Chernoff upper bound from Ref. 23 ( m = 4) are out of the range of the plot. 
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partially coherent communication systems is exp[— (a 2 + j8 2 )/2]/o(a/8), where 
typically, /0 > a > 0. Once again defining £ = a//} < 1 and using (4.12), we get 
a form analogous to (4.16), namely, 



A second function that is particularly useful in simplifying the error probability 
analysis of conventional differentially coherent communication modulations (i.e., 
M-DPSK) transmitted on the AWGN and fading channels and again has the 
desirable properties of finite integration limits and a Gaussian integrand was 
developed by Pawula et al. [2] in the general context of studying the distribution 
of the phase between two random vectors. In particular, for the M-DPSK 
application, consider the geometry of Fig. 4.5, where Si = Ae^ ,] and S 2 = Ae'^ 2 
represent the signal vectors transmitted in successive symbol intervals and 
Vj = R x e je ' and V 2 = Rie^ 2 are the corresponding noisy observations. The 
components of the zero-mean Gaussian noise vectors that produce Vi from Si 
and V 2 from s 2 each have variance rr and are uncorrelated. Denoting the angle 
between the signal vectors by A® = (</> 2 — 00 modulo 2 n and the corresponding 
angle between the noisy observation vectors by xjr = (0 2 — 0\ ) modulo 2 it, Pawula 
et al. [2] defined the function 



which like a probability distribution function is monotonically increasing in 
the interval —it < ij/ < tz except for a jump discontinuity at = A4>, where 



exp 






(4.66) 




Figure 4.5. Geometry for angle between vectors perturbed by Gaussian noise. 
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— F(AO + ) = — 1. For evaluating the symbol error probability of 
M-DPSK conditioned on a fixed amplitude A, the special case of AO = 0 is 
of interest since the symmetry of the problem allows one arbitrarily to assume 
transmission of a zero information phase (i.e., successive transmission of two 
identical signal vectors). For this case, (4.66) simplifies to 



sin r/r I " 1 f A 2 1 

F(rls)= / exp T (1 — cos i/rcos t) dt (4.67) 

47T J-k /2 1 — cos ijr cos t [ 2a 1 



Once again notice the similarity in form of (4.66) and (4.67) with the 
representations of the Gaussian and Marcum (^-functions in (4.2) and (4.16), 
respectively. 

Using the approach taken in Ref. 18 to arrive at the alternative forms of the 
first-order Marcum g-function in (4.26) through (4.29), a somewhat simpler form 
of (4.67) can be obtained as 



F{f) = - 



4jt 




A 2 sin 2 \fr \ , 
r at 

2o l 1 + cos x// cos t I 



(4.68) 



Here the trigonometric factor in the integrand of (4.67) is replaced by a different 
integrand for the exponential as well as integration limits that depend on the 
argument of the function. 
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APPENDIX 4A: DERIVATION OF EQ. (4.2) 



In this appendix we present two proofs of the alternative form of the Gaussian 
2-function given in Eq. (4.2). (A third proof can be obtained by applying the 
asymptotic relation between the Marcum and Gaussian g-functions as given in 
footnote 4 of this chapter to the closed form of the integral in Nuttall [4, Eq. (74)] 
in the limit as b approaches unity.) 

Consider the integral in Gradshteyn and Ryzhik [5, Eq. (3.363.2)], namely, 



(4A.1) 
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Multiplying both sides of (4A.1) by ^e 1 ' 11 and then letting u = y 2 gives 

1 e~ ,lx e IJ ' y2 7i 2 

-J 2 — 7 ==dx=— e^erfc(yVM) (4A.2) 

Now let u = x — y 2 in (4A.2). Then 

< 1 2 ^ r ^=f^ erf c(^) (4A.3) 

2 Jo (n+y 2 )Vn 2y 

Next, let u = t 2 , and du = 2 tdt = 2 y/udt. Thus (4A.3) becomes 

[ l , 2 dt = e ^ erfc(yv^) (4A.4) 

Jo t 2 + y 2 2y 

This intermediate form of the desired result appears as Eq. (3.466.1) in Ref. 5 
and also as Eq. (7.4.11) in Ref. 19. In addition, Pawula et al. [2, Eq. (34)] used 
it to derive their expression [2, Eq. (71)] for the average symbol error probability 
of Af-PSK. The reason for mentioning this here is that Pawula et al. point out 
clearly that for M = 2, [2, Eq. (71)] reduces to the well-known result for binary 
PSK, which is expressed strictly in terms of the Gaussian QTunction. Since for 
M = 2, [2, Eq. (71)] becomes the representation of Craig [1, Eq. (9)], as given 
here in (4.2), it is worthy of note that as early as 1982, Pawula recognized the 
existence of this alternative representation. We now proceed with the final steps 
to arrive at (4.2). 

Let y = 1 and /x = z 2 in (4A.4), which results in 
2 e ~ z2 ^ +1) 

- / 9 , - dt = erfc(z) (4A.5) 

TV Jo t 2 + 1 

Finally, let sin 2 # = (t 2 + l) -1 , cos 2 6 = t 2 (t 2 + 1 ) 1 , and dt = —(t 2 + 1 )d0, in 
which case (4A.5) becomes the desired result 

^ Jo CXP (~ sin 2 #) ^ = eifC(Z) (4A ' 6) 

or equivalently, letting z = x/a/2, 




dd = Q(x) 



(4A.7) 
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Another neat method of arriving at (4.2) is to start by extending the definition 
in (4.1) (with some name changes in the variables) to two dimensions, namely, 



a(z) =i [ vfe exp H) dy F vb exp (-7 ) dx 

= ~J So exp (~ * 2 y ) dydx (4A.8) 

Now make the change of variables from rectangular to polar coordinates, that is, 
X — V COS 0 

dx dy = r dr dxf) (4A.9) 



1 rn/l roo / r 2 \ 

Q(z) = - / rexpl-—)drd<j> 

K J0 Jz/ cos 0 V A / 



(4A.10) 



Finally, letting x = z and 0 = n /2 — 0, we obtain (4.2). 

The advantage of this proof over the former is that it can readily be extended to 
arrive at (4.9) for Q 2 (z ) as follows. Once again, start by extending the definition 
to two dimensions, namely, 

^ = r vs? " p (-7) dy [ vfc “ p (-7) dx 

=hs:s>{^¥) dydx (4A - n) 

Making the same change of variables as in (4A.9) and dividing the rectangular 
region of integration into two triangular parts gives 

Ql(z) = h rX;“ p (■?) drd4,+ ^ CIF:^ (“7) drd * 
= h r- bmi) (-2 ^) d * <4A 12) 



Letting x = z and also 0 = jt/ 2 — 0 in the second integral, then combining the 
two terms, we obtain (4.9). 
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USEFUL EXPRESSIONS FOR 
EVALUATING AVERAGE ERROR 
PROBABILITY PERFORMANCE 



As alluded to in Chapter 4, the alternative representations of the Gaussian 
and Marcum (^-functions in the desired form are the key mathematical tools 
in unifying evaluation of the average error probability performance of digital 
communication systems over the generalized fading channel. Before going on 
to present the specific details of such performances in the remaining parts 
of the book, we digress in this chapter to derive a set of expressions which 
can be looked upon as additional mathematical tools that will prove to be 
particularly useful in carrying out these evaluations. Each of these expressions 
will consist of an integral of the product of the Gaussian or Marcum Q-function 
and an instantaneous SNR per bit PDF that is characteristic of the fading 
channels discussed in Chapter 2 and will be specified either in closed form, 
as a single integral with finite limits and an integrand composed of elementary 
(e.g., trigonometric and exponential) functions, or as a single integral with finite 
limits and an integrand consisting of a Gauss-Hermite quadrature integral [1, 
Eq. (25.4.46)]. Since, as we shall see later, a great deal of commonality exists 
among the performances of various modulation/detection schemes over a given 
channel type, it will be convenient to have these expressions at one’s disposal 
rather than have to rederive them in each instance. It is for this reason that we 
have elected to include a mathematical chapter of this type prior to discussing 
the practical applications of such tools. 



5.1 INTEGRALS INVOLVING THE GAUSSIAN Q-FUNCTION 

When characterizing the performance of coherent digital communications, the 
generic form of the expression for the error probability involves the Gaussian 
2-function (and occasionally, the square of the Gaussian g-function) with an 
argument proportional to the square root of the instantaneous SNR of the 
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received signal. In the case of communication over a slow-fading channel, the 
instantaneous SNR per bit, y, is a time-invariant random variable with a PDF, 
p Y (y), defined by the type of fading discussed in Chapter 2. To compute the 
average error probability 1 one must evaluate an integral whose integrand consists 
of the product of the above-mentioned Gaussian g-function and fading PDF, 
that is, 2 

/= [°° Q(aVv)Py(y)dy (5.1) 

Jo 

where a is a constant that depends on the specific modulation/detection 
combination. If one were to use the classical definition of the Gaussian g-function 
of (4.1) in (5.1) then, in general, evaluation of (5.1) is difficult because of the 
presence of ^fy in the lower limit of the Gaussian g-function integral. If, instead, 
we were to use the desired form of the Gaussian g-function of (4.2) in (5.1), the 
result would be 



<5 - 2> 

where the inner integral (in brackets) is in the form of a Laplace transform with 
respect to the variable y. Since the moment generating function (MGF) 3 of y [i.e., 
My(s) = e sr p r (y)dy ] is the Laplace transform of p y (y) with the exponent 



1 In this chapter we do not distinguish between bit and character (symbol) error probability. 

2 This is the simplest form of integral required to evaluate average error probability performance 
and is characteristic of single-channel reception, which we discuss in great detail in Chapter 8. More 
complicated (e.g., multidimensional) forms of integrals are required to evaluate the performance of 
multichannel reception (see Chapter 9). However, in a large majority of cases, the new representation 
of the Gaussian g-function allows these to be partitioned into a product of single-dimensional 
integrals of the type in (5.1). Thus it is sufficient at this point to consider only integrals of this type. 

3 For a real nonnegative continuous random variable X, most textbooks dealing with probability 
define the moment generating function by Mx(t) = E[e ,x ) = e ,x px(x)dx, where t is a real 
variable. Based on this definition the nth moment of X would then be obtained from 



E{X n ] = ^M x (f)| 



Since our interest is primarily in the transform property of the moment generating function rather 
than on its ability to generate the moments of the random variable, for convenience of notation 
we replace the real variable t with the complex variable s, in which case the Laplace transform of 
the PDF is given by M x (—s) = / 0 °° e~ sx p x (x) dx. Also, if s is purely imaginary (i.e., ,v = joj ) one 
obtains the characteristic function, namely. 



xfxico) = E{e JmX } 



j: 



e jolx px(x) dx = Mx(jto) 
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reversed in sign, (5.2) can be rewritten as 

1 ( a 2 \ 

,= nl M A-T^) de <53) 

Since tables of Laplace transforms are readily available, the desired form of 
the Gaussian Q-function therefore allows evaluation of I in the simplest possible 
way, in most cases resulting in a single integral on 0 (when the Laplace transform 
is available in closed form). In the remainder of this section, we evaluate I of 
(5.3) for the variety of fading channel PDF’s derived in Chapter 2. 



5.1.1 Rayleigh Fading Channel 

The simplest fading channel from the standpoint of analytical characterization 
is the Rayleigh channel, whose instantaneous SNR per bit PDF is given by 
[see (2.7)] 

Py(y) = = exp , Y > 0 (5-4) 



where y is the average SNR per bit. The Laplace transform of the Rayleigh PDF 
can be evaluated in closed form with the result [2, Eq. (17)] 



M y (-s) = 



Substituting (5.5) into (5.3) gives 

1 [ n ' 2 



I = I r (a,y)= — f n ' (\-\ -7-^—^ dd=Ul-\ -^ 

7t Jo \ 2 sin 6 ) 2 \ y 1 + 



* y/2 
+ a 2 y / 2 



(5.6) 



5.1.2 Nakagami-q (Hoyt) Fading Channel 

For the Nakagami-g (Hoyt) distribution with instantaneous SNR per bit PDF 
given by [see (2.11)] 



. . 1 +q 2 

p ^ r)= ^r ap 



\ a + <? 2 ) 2 yl 


Io\ (l ~ q4)y ] 


4 q 2 y . 


l 4 q 2 y _ 



with Laplace transform [2, Eq. (109)] 



M y (—s) = 1 + 2 sy + 



(1 + q 2 ) 2 
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the integral in (5.3) evaluates to 



A _ 1 r n/2 \ a 2 

I = I q (a, q,y)=— / l + _^_ y + 
n Jo sin 6 



(1 + q 2 ) 2 sin 4 6> I 



5.1.3 Nakagami-n (Rice) Fading Channel 

For the Nakagami-n (Rice) distribution with instantaneous SNR per bit PDF 
given by [see (2.16)] 



r a+« 2 )7i, 
_ *0 




y J 


V Y 



PyiY) = 



with Laplace transform 4 

1 + n 2 ( n 2 sv 

My(-s ) = — — t-— exp -- 



1 + n 2 + sy 



1 +n 2 +syj 



y> 0 

(5.10) 

(5.11) 



the integral in (5.3) evaluates to 



I=I„(a,n,y ) 

= 1 f n/2 (1 + n 2 )sin 2 fl ^ [ n 2 a 2 y / 2 1 ^ 

n Jo (1 + n 2 )sin 2 6 + a 2 y/2 P [ (1 + n 2 )sin 2 6> + a 2 y/2j 
5 > 0 (5.12) 



To obtain the desired result for the Rician fading channel, we merely substitute 
n 2 = K in (5.12), which results in 

I = I n (a, K, y) 

a r , exp [ Ka J /2 ? he, 

nJo (1 + K) sin 2 0 + a 2 y/2 F L (1 + K) sin 2 9 + a 2 y/2\ 
s> 0 (5.13) 



5.1.4 Nakagami-m Fading Channel 



For the Nakagami-m distribution with instantaneous SNR per bit PDF given by 
[see (2.21)] 



y > 0 



(5.14) 



4 This particular Laplace transform is not tabulated directly in Ref. 2 but can be evaluated from 
definite integral in the same reference, in particular, Eq. (6.631.4). 
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with Laplace transform [2, Eq. (3)] 



the integral in (5.3) evaluates to 



I = I m (a, m, y) 



1 f”' 2 ( 



= -!' 
n Jo 



which can be evaluated in closed form using the definite integral derived in 
Appendix 5A, namely, 5 



ir( 1 + A) 

n Jo \ sin 9 J 






l - fjL(c)y 



m integer 

1 Jc T(m +\ ) 



{5 Alb) 



where 2 F i(-, •) is the Gauss hypergeometric function [1, Eq. (15.1.1)]. Thus, 

using (5.17) in (5.16) gives 



5>-(S)S(?)( i 



0*7/2 



\-a 2 y/2' 
Ja 2 yl2m T (m+5) 



2^/ir (1 + a 2 y /2m) m+l ! 2 T(m + 1) 
m noninteger 



integer 

2 F\ (l,m+l;m+U- 



\- a 2 y/2) ’ 

(5.18fe) 



Note that for m = 1, (5.18a) reduces to the result for the Rayleigh case as given 
by (5.6). 



5 This definite integral appears not to be available in standard integral tables such as Ref. 2. 
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5.1.5 Log-Normal Shadowing Channel 

For the log-normal shadowing distribution with instantaneous SNR per bit PDF 
given by [see (2.25)] 



Pvir) : 



10/ In 10 



-exp 



HO logic, Y ~ M) 
2a 1 



V27ta 2 y 

M( in dB) = 101og 10 y 

cr(in dB) = logarithmic standard deviation of shadowing 



the Laplace transform cannot be obtained in closed form. Instead, we substitute 
(5.19) into (5.2) directly and then make a change of variables, namely, x = 
(lOlogio y ~ /x)/V2a, which results in 

= ; jf [Js£> (-is* ^ w ^ w °) " <5 20) 



The inner integral can be efficiently computed using a Gauss-Hermite quadrature 
integration [1, Eq. (25.4.46)], that is, 



_L r exp ( fl_ . 10 (W2 , + m)/.<A e^dx 

J-oo V 2 sin 2 6 J 

:=^Y W, exp ( . 10 ^+^/A 

Jn y V 2 sin 2 6 ) 



(5.21) 



where {x,}, i = 1,2 ,...,«, are the zeros of the nth-order Hermite polynomial 
H e n (x) and { vv, } , i = 1 , 2, .... n, arc weight factors tabulated in Table 25.10 of 
Ref. 1 for values of n from 2 to 20. Since the x, ’s and w, ’s are independent of 0, 
substituting (5.21) in (5.20) and making use of the desired form of the Gaussian 
(/-function as given in (4.2), we get 



/in (a, n, a) = -J= y w iQ(a'/ 10< *.vW)/ 10 ) (5.22) 

where the value of n is chosen depending on the desired degree of accuracy. 



5.1.6 Composite Log-Normal Shadowing/Nakagami-m 
Fading Channel 

The class of composite shadowing-fading channels is discussed in Section 2.2.3. 
A popular example of this class that is characteristic of congested downtown areas 
with a large number of slow-moving pedestrians and vehicles is the composite 
log-normal shadowing/Nakagami-m fading channel. For this channel, p y (y) is 
obtained by averaging the instantaneous Nakagami-m fading average power 
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(treated now as a random variable) over the conditional PDF of the log-normal 
shadowing, which from (5.14) and (5.19) results in the composite gamma/log- 
normal PDF 



p ' (y) = r 



(101og 10 Q - n) 2 ' 
2a 2 



y > 0 



Since the Laplace transform of the Nakagami-m fading portion of (5.23) is known 
in closed form [see (5.15)], the Laplace transform of the composite PDF in (5.23) 
can be obtained as the single integral 



x ( '^L 10 exp L (101 °gio^> 2 1 } dSlt 

l « L 2cr 2 JJ 



5 > 0 (5.24) 



Substituting (5.24) into (5.2) and then making a change of variables, namely, 
x = (101og 10 O — [i)j\p2a , results in 



= -[ f ! fl+ — a e~ x2 dxde (5.25) 

n Jo JnJ- ooV 2m sin 2 6 ) 



Once again the inner integral can be computed efficiently using a Gauss-Hermite 
quadrature integration [1, Eq. (25.4.46)], that is, 



■ IO^T+,0/10) e -* 2 dx 



jsJZi'H 

V vv, ( 1 + — ■ loto'fr+aw) (5.26) 

■sfn “ V 2m sin 2 0 ) 

Since, as mentioned previously, the x,’s and vr,’s are independent of 0, then 
substituting (5.26) in (5.25) and making use of the closed-form integral in (5.17a), 
we get 

(?) (^)l ' 

Hied = \l ~r~ — . Ci= ?—■ lO^'^+^Vio (5.27) 
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Before moving on to a consideration of integrals involving the Marcum Q- 
function, we give brief attention to integrals involving the square of the Gaussian 
Q-function, since these will be found useful when we discuss evaluating average 
symbol error probability of coherently detected square QAM over generalized 
fading channels. Analogous to (5.1), then, it is of interest to evaluate 



/= [°° Q 2 (a^)p y (y)dy (5.28) 

Jo 

for the various fading channel PDFs. Using the classical definition of the Gaussian 
g-function, such integrals would be extremely difficult to obtain in closed form 
since Q 2 (a^/y) would be written as a double integral each of which has «Jy in its 
lower limit. However, in view of the similarity between the desired forms of the 
Gaussian g-function and the square of the Gaussian g-function [compare (4.2) 
and (4.9)], in principal it becomes a simple matter to evaluate I of (5.28) — in 
particular, one merely need replace the 7r/2 upper limit in the integration on 0 in 
the evaluations of I of (5.1) with n / 4 to arrive at the desired results. Although this 
may seem like a simple generalization, depending on the channel, the foregoing 
replacement of the upper limit can lead to closed-form expressions that are 
significantly more complicated. For the Rayleigh fading channel, the analogous 
result to (5.6) is straightforward in view of the fact that the indefinite integral 
form of this equation has a closed- form result [see (5A.11) in Appendix 5A], 
Thus, using (5A.13), we arrive at 



I = lf\a, y) 



1 r n < 

Tt Jo 




For the Nakagami-m channel with m integer, the result is considerably more 
complex than (5.18a). However, using (5A.17) with M = 4, we obtain 



/ = 4 2) (a, m, y) 
1 f^ 4 ( 



_ 1 r 

n Jo 

— sin (tan '' a ) ^ ^ ^ [cos (tan -1 a)\ 2(k ~ n+] | 



(5.30) 
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where 



and 



'( 2 f/ A 



a 2 y /2 

1 + c Y m + a 1 yl'l 

M 



(5.31) 



(5.32) 



5.2 INTEGRALS INVOLVING THE MARCUM Q-FUNCTION 

When characterizing the performance of differentially coherent and noncoherent 
digital communications, the generic form of the expression for the error 
probability typically involves the generalized Marcum (2-function, both of whose 
arguments are proportional to the square root of the instantaneous SNR of the 
received signal. To compute the average error probability over a slow-fading 
channel, one must evaluate an integral whose integrand consists of the product 
of the above-mentioned Marcum (2-function and the PDF of the instantaneous 
SNR per bit. Thus, analogous to (5.1), we wish to investigate integrals having 
the generic form 

1= [ Qi( a >/Y’ by/y)p y (y)dy (5.33) 

Jo 

where a and b are constants that depend on the specific modulation/detection 
combination, / the order of the Marcum (2-function, and p Y (y) again depends on 
the type of fading, as discussed in Chapter 2. As was true for the Gaussian 
Q-function, if one were to use the classical definition of the Marcum Q- 
function given by Eq. (4.33) in (5.33), then, in general, evaluation of (5.33) 
is difficult because of the presence of Jy in the lower limit of the Marcum 
2-function integral. If, instead, we were to use the desired form of the 
Marcum 2-function of (4.42) or (4.50) in (5.33), the result of this substitution 
would be 

j = j_ r r ( ^ 1) {cos[q - m + g/2)j - £cos[/(a + n/im 
2 tt J n l + 2£sin(9-K 2 

X {Jo CXP + 2 £ sin6l + f 2 )] PviY)dY^de, 

0+ < f = a /b < 1 



(5.34) 
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or 



1 = _ J_ r £'{cos[/(fl + 7 t/ 2)] - £cos[(Z - 1)(0 + n/2)]} 

2jt J_ n 1 + 2£ sin 0 + i; 2 

x {Jo exp [-^( 1 + 2 ^ sin0 + ^ 2 )] PvM d y} d0 < 

0 + < £ = b/a < l (5.35) 

where the inner integral is again in the form of a Laplace transform with respect 
to the variable y. That is, if, as in Section 5.1, M v {s) = / 0 °° e sy p y (y)dy denotes 
the MGF of y, (5.34) and (5.35) can be rewritten as 

I = J_r r (/ ~ 1} { cos[(f - 1 )(fl + n/2)\ - £cos[/(fl + n/ 2)]} 

2 n]_ n 1 + 2£ sin # + £ 2 

x M y [-y(l + 2 ^ s in6> + f 2 )] d6», 0 + <f = a/Z><l (5.36) 



, _ _ J_ r ^{cos [1(9 + 7T/2)] - f cos[(/ - 1)(0 + ;r/2)]} 

27r J- n l + 2fsin0 + f 2 

xM y J-|-(l+2£sin0 + Z; 2 )] dO, 0 + <Z = b/a<l (5.37) 

In the remainder of this section, we evaluate I of (5.36) for the variety of 
fading channel PDFs derived in Chapter 2, where, for simplicity of notation, we 
introduce the functions 

gm)= l + 2£ S in0 + ? 2 

h(0; t, l ) = r ( ' _1) {cos [(/ - 1) (e + |)] - £ cos [z (e + |)] } (5.38) 

Also, the corresponding results for I of (5.37) can then be obtained by inspection. 

5.2.1 Rayleigh Fading Channel 

For the Rayleigh channel with a Laplace transform of the instantaneous SNR per 
bit PDF given by (5.5), the integral I of (5.36) [or equivalently, (5.33) for a < b] 
evaluates to 



,A, rKM= ir«M[ , 
2 nJ-„ «(»;?) [ 
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5.2.2 Nakagami-q (Hoyt) Fading Channel 

For the Nakagami-g (Hoyt) distribution with a Laplace transform of the 
instantaneous SNR per bit PDF given by (5.7), the integral I of (5.36) evaluates to 



I = J q (b, q,y,l ) 



j_ r h{e\s,i) 
21 tJ.„ g{0;$) 



\ + b 2 yg{9^) + 



q 2 b 4 y 2 g 2 (9 -,S) 

(1 +q 2 ) 2 



-1/2 

d9 



(5.40) 



5.2.3 Nakagami-n (Rice) Fading Channel 

For the Nakagami-n (Rice) distribution with a Laplace transform of the 
instantaneous SNR per bit PDF given by (5.11), the integral I of (5.36) 
evaluates to 



I = J n (b, £, n, y, l) 



-hi: 



h(9; £, /) 

8(0; Q 



x 



1 + n 2 

\+n 2 + {b 2 y/2)g(9-,S) e 



n 2 (b 2 y /2)g(9; £) \1 

1 +n 2 + (b 2 y/2)g(9-,Z))\ 



(5.41) 



or equivalently, in terms of the Rician parameter 



I = J n (b, K,y,l) . 



-a: 



h(9;Z,l) 

8 ( 0 ;?) 



1 + K ( (Kb 2 y/2)g(9-K) V 

1 +K+ (b 2 y/2)g(9; ?) CX? V 1 + K + ( b 2 y/2)g(9 ; ?) ) _ 



d9 



(5.42) 



5.2.4 Nakagami-m Fading Channel 

For the Nakagami-m distribution with a Laplace transform of the instantaneous 
SNR per bit PDF given by (5.15), the integral I of (5.36) evaluates to 

= + ' de <5 43> 
which reduces to (5.39) for the Rayleigh (m = 1) case. 



5.2.5 Log-Normal Shadowing Channel 

As discussed in Section 5.1.5, the Laplace transform of the instantaneous SNR 
per bit PDF for the log-normal shadowing distribution cannot be obtained in 
closed form. Thus, we proceed as before and substitute (5.19) directly into (5.34) 
and then make a change of variables, namely, x = (101og 10 y — /x)/a/2<t, which 
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results in 



a 1 r* h(6;t,l) 



■ X roc 

.7^ Lx 



( bl S^'Q _ 10 (^V2<r+/x)/10 N 



The inner integral can be efficiently computed using a Gauss-Hermite quadrature 
integration [1, Eq. (25.4.46)], that is, 

_L J°° exp . 10 <^«/.o^ e s dx 

= (5.45) 



Substituting (5.45) into (5.44) and making use of the desired from of the 
generalized Marcum Q-function as given in (4.42), we get 



J ]n (b, £, /r, a, l) = -7 WiQi (b^V lO^^+^/'o, bV ioC»^+#*)/io) 



5.2.6 Composite Log-Normal Shadowing/Nakagami-m 
Fading Channel 

Finally, we consider the composite log-normal shadowing/Nakagami-m fading 
channel treated in Section 5.1.6. For this channel, we again make use of the 
single integral form of the Laplace transform of p Y (y) as given in (5.24), 
which upon substitution into (5.36) together with the change of variables 
x = (101og 10 — n)/-j2o results in 



I = J g /i a (b, /r, <r, m, l) 

= — f Ll r (, + . 10 <w-^,.yv J d9 

2n J-„ g(0;Z) [vW-ooV 2 m ) \ 

(5.47) 

Once again the inner integral can be computed efficiently using a Gauss-Hermite 
quadrature integration [1, Eq. (25.4.46)], that is, 

_L J°° () + e-’dx 

= Ty,, (\ + (5.48) 

V 2 m ) 
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Substituting (5.48) in (5.47) and making use of the closed-form integral in (5.17), 
we get 






b 2 g(0\K) 
h 2m 



h{0\S,l) 

10 feV2a+ M )/lo\ 



Unfortunately, because a closed-form result was not obtainable for (5.43), we 
cannot similarly obtain a closed-form result for (5.49). 



5.3 INTEGRALS INVOLVING THE INCOMPLETE GAMMA FUNCTION 



In the preceding section, we considered integrals involving the Marcum 12- 
function Q m (a, p), 0 < a < /$, where the desired form of this function as given 
by (4.42) was used to simplify the evaluations. A special case of the Marcum 
2-function corresponding to its first argument equal to zero is expressible as 
a ratio of complementary Gauss incomplete gamma functions [see Eq, (4.44)]. 
As we shall see in Chapter 8, integrals involving such a ratio are appropriate 
to the unification of the error probability performance of coherent, differentially 
coherent, and noncoherent binary PSK and FSK systems over generalized fading 
channels. However, since the desired form of the Marcum (7-function of (4.42) 
requires that the first argument be greater than zero, the specific results derived 
in Section 5.2 cannot be used in this instance. Fortunately, however, the special 
case Q m ( 0, fi) can be put in a separate desired form 6 as given by (4.45). In this 
section we derive the analogous results to those in Section 5.2 using this special 
desired form of Q m { 0, /3). 

Based on the discussion above, then, we are interested in evaluating 

r°° r°° ra, b 2 y/2) 

1= / 2/(0, b^/y)p Y (y)dy = / — f ’ p Y (y)dy (5.50) 

Jo Jo F(/) 



for the various characterizations of p y (y) or substituting the form of (4.45) in 
(5.50), we are equivalently interested in evaluating 



f°° (b^/y) 21 r' 2 cosd 

Jo 2 / ~ 1 r(Z) Jo (sin 0y+ 21 



exp 




d0p y (y)dy 



(5.51) 



6 The desired form of the integral for Q m ( 0, fi) is slightly less desirable than that for Q m (a, fi), 0 < 
a < fi, in that the integrand contains a term ft 2m in addition to the usual Gaussian dependence on fi. 
Nevertheless, it is still useful in carrying out integrals involving the statistics of the fading channel 
by using Laplace transform manipulations. 
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Reversing the order of integration and grouping together like variables, we can 
rewrite (5.51) as 



b 21 f 71 ' 2 cosO f°° , 

'= 2 FwJ. 




p y (y)dyd0 



(5.52) 



where the integral on y is in the form of a Laplace transform that is similar to 
but slightly more complicated than the MGF of y. 



5.3.1 Rayleigh Fading Channel 

Substituting (5.4) in (5.52) and making u 



5 of Eq. (3.381.4) of Ref. 2,\ 



a fb 2 y\ l r /2 cos <9 ( b 2 v \ - ' -1 



obtain 

(5.53) 



Making the change of variables t = (l + b 2 y/2 sin 2 0) 1 , after some manipulation 
we arrive at the equivalent compact result 



Mb, y,l ) 



where 



/■(I +t?y/2)- 1 

l (l-t)‘- l dt = lB a+l y m) - l (l,l) 

Jo 

BAp,q)= f t p -\l-t) q ~ l dt 
Jo 



(5.54) 

(5.55) 



is the incomplete beta function [2, Eq. (8.391)]. 



5.3.2 Nakagami-q (Hoyt) Fading Channel 

Substituting (5.7) in (5.52) and making use of the Laplace transform found 
in Erdelyi et al. [3, Eq. (8)], recognizing the relation between the associated 
Legendre function and the Gaussian hypergeometric function [2, Eq. (8.771.1)], 
we obtain 



I = J q (b, q,y,l ) 



i( b 2 y\ ( t q2 \ f n/2 cos ^ 

V 2 ) V q ) Jo (sin ey +21 



x 



[ ( b 2 y (1 +q 2 ) 2 \ 2 
[Usin 2 0 4 ^ ) 

( 




-W+D/2J 



b 2 y | (1 + q 2 ) 2 
2 sin 2 0 4r/ 2 ^ 

' b 2 y G + r)V n - g 4 y 

^2 sin 2 9 4^ 2 ) \ 4r/ 2 / / 

(5.56) 



x iFi 
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5.3.3 Nakagami-n (Rice) Fading Channel 

Substituting (5.11) in (5.52) and making use of the Laplace transform found in 
Endelyi et al. [3, Eq. (20)], then recognizing the relation between the Whittaker 
function and the confluent hypergeometric function [2, Eq. (9.220.2)], we obtain 



/ = J n (b. n, y,l) 

= 21 ' (1 + „V" 2 r C ° Sg fl+n 2 + > l 

V 2 ) U+ " )£ J 0 (sin 9) l+21 V 2sin 2 e) 

XiFi(l + l, 1; \ (1 \ ~ } 9 )d0 (5.57) 

V \+n 2 + b 2 y/2sm 2 6) 

or equivalently in terms of the Rician parameter, 

I = J n (b, K, y,l ) 

fb 2 y\ l _ K r /2 cos 0 ( b 2 v \~ l ~ l 

= 21 {—J (l+K)e l ^^V +K+ J^) 



' l+K + b 2 y/2sm 2 0j 
where iFi(-;-;-) is the confluent hypergeometric function [2, Sec. 9.20], 



5.3.4 Nakagami-m Fading Channel 

Substituting (5.15) in (5.52) and making use of Eq. (3.381.4) of Ref. 2, we obtain 



I=J m (b, m, y, l)= 



'b 2 y\ l M 2 cosd 
,2m) J 0 (sin 9) l + 21 






2mi§if 0/ 



where 



B(m, l) = B(l, m) = 



r(m)r(/) 
T(m + /) 



-l-m 

d0 

(5.59) 

(5.60) 



is the beta function [2, Eq. (8.384.1)]. Making the change of variables t = 
(1 + b 2 y/2msin 2 0)~ l , then after some manipulation we arrive at the equivalent 
compact result 



J m (b,y,l) 



1 [V 

= B(m, l) Jo 



t m ~\l - t) l -'dt = 



(5.61) 
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or in terms of the incomplete beta function ratio [2, Eq. (8.392)], 



IAp,q) 



i B X (P, q) 

' B(p, q) 



the still simpler form 



Jm(b, y, l ) = I(l+biy/2m)-'{m, l ) 



(5.62) 



(5.63) 



For the Rayleigh (m = 1) case, (5.61) clearly reduces to (5.54) since 
R(l, /) = /-'• 



5.3.5 Log-Normal Shadowing Channel 

Substituting the PDF of (5.19) into (5.52) and making the change of variables, 
x = (101og 10 y — p)/\f2a results after much simplification in 

i=JUb, P, <7, Z) = J2 r ( z ’ y • 10^+^ (5.64) 

where again {x,}, i — 1, 2, . . . , n, are the zeros of the nth-order Hermite 
polynomial He n (x), as discussed in Section 5.1.5. 

5.3.6 Composite Log-Normal Shadowing/Nakagami-m 
Fading Channel 

Finally, for the composite log-normal shadowing/Nakagami-m fading channel 
treated in Section 5.1.6, we substitute the PDF of (5.23) into (5.52) together with 
the change of variables x = (101og 10 — /x)/V2rr, resulting in 

I = Jg/in(b, p, ( 7 , m, l) = -^= w i I\ |i+(fe2/2m).io'vv^+M)/iO| i (m, Z) (5.65) 

where now in addition {w,}, i = 1,2 , ,n, are the Gauss -quadrature weights 
as discussed in Section 5.1.5. 



5.4 INTEGRALS INVOLVING OTHER FUNCTIONS 

When studying the error probability performance of certain modulation schemes 
over generalized fading channels, we shall have reason to evaluate integrals 
involving special functions other than the three considered previously in this 
chapter. In this section we consider integrals involving two such special functions 
corresponding to well-known modulation schemes. 
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5.4.1 M-PSK Error Probability Integral 

When studying the average error probability performance of M-PSK over 
generalized fading channels, we shall have reason to evaluate integrals of the 
form 



roo l AM— I )jt/M / a 2 \ 

C= - exp - , d0p Y (y)dy 

Jo * Jo \ 2 sin z 6j 

1 AM—\)jt/M v roo ( a 2 y \ 1 

= nl [l " P (" PA)dr\ dt> (5.66) 



where specifically a 2 = 2sin 2 7r/M. The integral in (5.66) is a generalization 
of the one in (5.2) in the sense that the latter is a special case of the form 
corresponding to M = 2. Thus (5.66) follows directly from (5.3) and is given by 




7T 




(5.67) 



Although this may seem like a simple generalization, unfortunately the replace- 
ment of the 7r/2 upper limit in (5.3) by (M — 1)7 r/M results wherever possible 
in closed- form expressions for (5.67) that, in general, are significantly more 
complicated. Without further ado, we present the results for the evaluation of 
(5.67) corresponding to the various types of fading channels, where closed-form 
results can be obtained. The results corresponding to the remainder of the fading 
channels can be obtained by the same upper limit replacement as mentioned 
above in the corresponding expressions of Section 5.1. 



5.4.1. 1 Rayleigh Fading Channel. Substituting (5.5) in (5.67) and making 
use of (5A.15), we obtain 



K = K r (a, 



J r(M—l)7T/M 

7T Jo 



A L.) 

2 sin 2 #/ 



dd 



M - 1 \ I cty/l M 7t 
M | ~ V 1 +a 2 y/2 (M - 1)tt 2 



tan 



f I a 2 y/2 
V 1 + a 2 y / 2 




which reduces to (5.6) when M = 2. 



(5.68) 



5.4. 1.2 Nakagami-m Fading Channel. Here we need to substitute the 
Laplace transform of (5.15) into (5.67). After this is done, then making use 
of (5 A. 17), we obtain 
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K = K m (a, y, m, M) 




M-l 1 I a 2 y/2m \ cn \y-!/2&\ 1 

M n V 1 + a 2 y/2m \ V 2 + 311 7 ^ V * / [4(1 + a 2 y/2m)] k 



+ sin(tan 1 a) 



— (1 + a 2 y/2m) k 



[cos(tan 1 a)] 2 



t-O+ij 



where 



cry 12m 
1 + a 2 y!2m C 



(5.70) 



and Tik is again given by (5.32). 



5.4.2 Arbitrary Two-Dimensional Signal Constellation Error 
Probability Integral 

As a generalization of QAM, Craig [4] showed that the evaluation of the average 
error probability performance of an arbitrary two-dimensional (2-D) signal 
constellation with polygon- shaped decision regions over the AWGN channel can 
be expressed as a summation of integrals of the form 7 



Pi = 



J_ r e ‘ r a 2 sin 2 ^ 
2jt ,/o ^ 



de 



(5.71) 



where a? is a signal-to-noise ratio parameter associated with the /th signal in 
the set and 0; and ^ are angles associated with the correct decision region 
corresponding to that signal. Thus, when studying the average error probability 
performance of these 2-D signal constellations over generalized fading channels, 
we shall have reason to evaluate integrals of the form 



- Chl>- 

l r e ‘ j r°° 

2n Jo |./o 



2sin 2 (6>-M/ f «) 

afy sin 2 i//; 



d0p Y (y)dy 



\p r (y)dy\d0 (5.72) 



7 Equation (5.71) appears as Eq. (13) in Ref. 4 but with an error of a factor of \ [i.e., the factor 1/jr 
that premultiplies the integral there should be 1/2 tt, as shown in (5.71)]. 
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By comparison with (5.66), we observe that (5.72) can be expressed in the form 
of (5.67), namely, 



L 




f sin 2 fa 
sin 2 (0+fi) 



(5.73) 



where again M y {s) is the MGF of y. Evaluation of the Laplace transform 
integrand in (5.73) for the various types of fading channels follows exactly along 
the lines of the previous results and hence is not repeated here. Unfortunately, 
however, for arbitrary 0,- it is not always possible now to obtain closed-form 
expressions for L even when the integrand is obtainable in closed form. However, 
for the Rayleigh channel, using (5.5) for M y (—s ) and the indefinite form of the 
integral in (5A.11), it is straightforward to obtain the following closed-form 
solution: 



L = L r (a.i, y, Oi, ipi) 




For Nakagami-m fading, using the Laplace transform in (5.15), we obtain 



L = L m {ai , y, m, 9 t , ft) 




with a still as defined in (5.75). If, depending on the signal constellation, 0,- and 
Oi — \jfi both turn out to be either in the form (Af — 1)7 x/M or n/M for M = 2 m , 
m integer, the closed-form results of (5A.16) and (5A.21) can be used to obtain 
(5.76) in closed form. Otherwise, the single-integral form of (5.76) must be used. 

The results for the other fading channel types will, in general, be expressed 
as a single integral with finite limits (0, 0,) in accordance with (5.73) and the 
various closed-form expressions previously obtained for M y (—s). 
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5.4.3 Integer Powers of the Gaussian Q-Function 

Associated with the study of the average error probability performance of 
coherent communication systems using differentially encoded QPSK and M - ary 
orthogonal signals in the presence of slow fading, we shall have need to evaluate 
integrals of the form 

/*= r Q k (- a Vy)Pr(Y)dy (5.77) 

Jo 

where k is assumed to be integer. In general, for arbitrary integer values of k, A 
cannot be obtained in the desired form. However, certain special cases, namely, 
k = 1, 2, 3, 4, do exist either in closed form or in the form of a single integral 
with finite limits and an integrand composed of elementary functions. For k = 1, 
the results were presented in Section 5.1. The specific results corresponding to 
k = 2, 3, 4 for Rayleigh and Nakagami-m fading are presented in what follows. 



5.4.3. 1 Rayleigh Fading Channel. To evaluate (5.77) for k = 2, we substi- 
tute the alternative form of Q 2 (x) of (4.9) into this equation, resulting in 



1 M 4 ( a 2 \ 

h = - My( =- a 

n Jo \ 2 sin 2 0J 



(5.78) 



which is identical to (5.3) except that the upper limit is now 7t/4 rather than n/2. 
Using (5.5) for M Y {—s), (5.78) becomes [analogous to (5.6)] 



a 1 [ n / 4 ( a 2 v \ 1 

h= l >Aa,r) = -l + * 

_ i r 

TV Jo 



I 2 9 + a 2 y/2 



(5.79) 



The integral in (5.79) is evaluated in closed form in Appendix 5A. In particular, 
using (5A.13), we obtain 



a ay 
C ~^2 



For k = 3, an expression for Q 3 (x) in the form of (4.2) and (4.9) has not been 
found. Nevertheless, it is still possible to evaluate 1 3 in the single-integral form 
referred to above. In particular, writing Q 3 (x) as the product Q(x)Q 2 (x) and using 
(4.2) and (4.9) in (5.77), the following sequence of steps occurs. 

h=h,Mv) = - r' - f 1 /°exp & + -J-)] Py (y)dyd9dcl> 

tv Jo tv Jo Jo [2 \sin 0 sin 2 <j>J\ 




dOd(/> 
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= -[*'- [*' ( 1 + ° \ ) d0dxp 

n Jo n Jo V 2 siir 6> 2 sin 0 ) 

1 f^ 4 2 [1 r' 

^ Jo a y [ n Jo 



sin 2 0 + c{4>) 



a ay 

m=^- 



(5.81) 



Using the closed-form result from (5A.9) for the inner integral (in brackets), we 
get the desired result 



hA a ’ Y) = (a y)' 



j r 7 

77 Jo 



1 + C(0) 






(5.82) 



It is also possible to obtain a single-integral form for / 4 by writing 0 4 (x) 
as the product Q 2 (x)Q 2 (x) and then using (4.9) twice in (5.77) followed by the 
closed-form expression in (5.80) to evaluate the inner integral. The steps leading 
to the result parallel those in (5.81) and produce 



a i r n / 4 2 h ri 

h=hA“,Y) = - / - / 

7i Jo a z y tv Jo 



sin 2 0 + c(4>) 



d0\ dcj> (5.83) 



Finally, using Eq. (5A.13) for the integral in brackets in (5.83) produces the 
desired result: 




(5.84) 



5.4.3.2 Nakagami-m Fading Channel. Following the same procedure as for 
the Rayleigh fading channel, we can evaluate (5.77) for the Nakagami-m fading 
channel as follows. For k = 2, we again start with (5.78) but now use (5.15) for 
M y (—s), which produces [analogous to (5.16)] 



h = h,m(a, 



o = - r 

77 Jo 




d0 



1 r* /4 f sin 2 0 V 
7T Jo y sin 2 0 + a 2 y/2 J 



d0 



(5.85) 
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The integral in (5.85) is evaluated in closed form in Appendix 5A. In particular, 
using (5A.21), we obtain (for m integer) 

h - (a ’ m ' n = 5 ' {(?-•“' g (? ) 

x r — sin flan -1 \ l C ^ ^ 

[4(1 + c )]* V Vi + c / fr ^ 



+^ trtr( l + c ) i 






where c is defined in (5.80) and T in (5.32). For ft = 3, the steps analogous to 
(5.81) are as follows: 



h=h,m(fl, m,y) 

l r*/4 l rn/ 2 



ri r M r 

It Jo tt Jo 

1 n r/4 l rx/ 2 
Tt Jo X JO 

-- - f /4 (~^c(<P)) I -f 

It Jo \a Y ) \tt Jo 



2m sin 2 ft 2m sin 2 0 

m \ i r' 2 



d0 d(j) 

) d0d<p 

dd\ dcj) (5.87) 



where c(0) is still as defined in (5.81). Using the closed-form result in (5 A. 4ft) 
we obtain the desired result as 



h, m (a,m,Y)=- f /4 (-^cW) - 

it Jo \a 2 y ) L 



1 - Ai(c(0))l m 



<J2( m ~l +k ) \ ]+l f m ] k d<P (5.88) 

k = 0 ' ' t 



where [see (5A.4a)J 



Finally, for ft = 4 we get 

h=h,m{a, m,Y ) 

1 ft */ 4 1 



1 ft*/ 4 1 ft*/ 4 \ a 2 ( l 1 \1 

= -/ - My — d 6 dxp 

it Jo it Jo L 2 \ sin - ft sin 0 / . 
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whereupon using (5.86) for the term in brackets with c replaced by c(<j>), we get 
I a ,m(a,m,y) 




Although an equation like (5.91) gives the appearance of being complex, we 
remind the reader that we have accomplished our goal, namely, to express 
the result in a form no more complicated than a single integral with finite 
limits and an integrand containing elementary (in this case, pure trigonometric) 
functions. 



5.4.4 Integer Powers of M-PSK Error Probability Integrals 

Associated with the study of the average error probability performance of 
coherently detected differentially encoded M-PSK in the presence of slow fading, 
we shall have need to evaluate integrals of the form 

pAr)dy <5 92> 

and 

[i^'exp <*»] 

x [^.^ exp (■I&)^ ,v<,/) ‘ ^, ' <5 - 93) 
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where, as was the case in Section 5.4.1, a 1 = 2sin 2 7T /M, and now, in addition, 
a\ and a\ assume the possible values 2 sin 2 (2 k ± l)n/M , k = 0, 1, 2, . . . , M — 1, 
and 0 u i and 0 U 2 assume the possible values tc[\ — (2k ± 1 )/M], While (5.92) can 
be evaluated in the desired form for both Rayleigh and Nakagami-m fading, 
unfortunately, (5.93) can be obtained in such a form only for the Rayleigh case. 
Thus we shall only present the results for this single fading case. 

5.4.4.1 Rayleigh Fading Channel. Since (5.92) can be viewed as a special 
case of (5.93) corresponding to a 2 = a\ = a 2 and 0 U \ = #„ 2 = (M — \)n/M, we 
shall consider only the generic form in (5.93), where aj, a\, 0 U \ , and d U 2 are 
allowed to be completely arbitrary. Following steps analogous to those in (5.81), 
we proceed as follows: 



0 U 2, ai, CI2) 



= - [ 6ul - f‘ a My [-i ( 1 d6 d<t> 

Tt Jo JT Jo L 2 \ Sin2 ^ Sin2 ^ / J 

=1 r i - p(i + j&2+-^Ydod* 

Jt J 0 n Jo V 2 sin 6 2 sin 0 / 

1 f (2 \ \ 1 l‘ Su2 si 

z - — C12(0) - / — T— 

7T Jo V«lK / JT Jo Sim 0 



dd\ dtp (5.94) 



where c\ 2 (<P) is defined analogous to c(tp) in (5.81) as 



_ sin 2 0 \ 

2 \^sin 2 <p + a 2 Y/2 J 



Rewriting the integral in brackets as 



r ; 



-d6 : 



rU U 2 

Jo sin 



c 12 (0) 



sin 2 0 + ci 2 (0) ” Jo sin 2 0 + ci 2 (0) 

then making use of Eq. (2.562.1) of Ref. 2, we obtain 



r0, a 

Jo sin 2 



0 + c n (<P) 



-d9 



tmd u2 (5.97) 
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and hence 

L 2 (0 u u0 U 2,a l ,a 2 )= (-} -^= [ < 

\7tJ afy Jo 



- tan 9 U 2 dcj) 



(5.98) 

Since as mentioned above, K 2 = L 2 ((M — \)n/M, (M — a, a), this 

special case evaluates as 



/1\ 2 2 rW-i)n/M \(M- l)n 
-- - ~2= / C(<A) 

W/ a-yio 



1 + c(0) 



x tan' 



( 1 1 + c(<j>) 

VV c(0) 



tan 



dd> 



(5.99) 



where c(0) is as defined in (5.81). The other special cases that will be of interest 
in later chapters dealing with differentially encoded, coherently detected M-PSK 
are L 2 (6+, 6+, a+, a+), L 2 (0-,0-,a ,a ), and L 2 {9+, 6-,a+, a_), where 
0± =n[l - (2k ± 1 )/M], a\ = 2sin 2 (2£ ± 1 )tt/M, fe = 0, 1, 2, . . . , M - 1. 
These special cases of (5.98) evaluate as 



Li(6±, 0±, a±, a±) 



1 \ 2 / 2 \ rxV-VteD/M) 



x { \/ ,an K 1 ~ ^ir 1 )] }] ^ <5 ' 100> 



and 

1-4(6+, a+, a_) 



/i\ 2 / 2 \ ^a-(2fc+i)/M) r / 2* — i \ r 

-u)u ?)/. ^K 1 -- 5-)-vi2 



C+-(0) 



(5.101) 
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where 



c^ a -f 



' siir^ \ 

^sin 2 4>+a\y/2J 



. Sin ^_ ) 
sm 2 cj)+a 2 Ly/2j 



(5.102) 
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APPENDIX 5A: EVALUATION OF DEFINITE INTEGRALS ASSOCIATED 
WITH RAYLEIGH AND NAKAGAMI-m FADING 




We wish to consider evaluating the integral 




for m both integer and noninteger. To do this we shall make an equivalence with 
another definite integral for which closed-form results have been reported in the 
literature. In particular, it has been shown [5, Eq. (A8)] that the integral 

J m (a, ^ e~ at t m - l Q(Vbt)dt, n > 0 

r(m) Jo 



(5A.2) 
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has the closed-form result 



' 2(1 + c) m + 1 /2 T(m+ 1 ) 



When m is restricted to positive integer values, it has been further shown [5, 
Eq. (A13)] that (5A.3) simplifies to 



which was also obtained previously by Proakis [6, Eq. (14-4-15)] in the form 



Using the alternative representation of the Gaussian g-functio 
Eq. (4.2) in (5A.2) gives 



Jm (a,b)=^- r e - at t m ~ i r 

r(m) Jo \n Jo 

=-?- r'frt-w 

nVirn) J 0 Jo 



sme)t dtdO (5A.5) 



The inner integral on t can be expressed in terms of the integral definition of the 
gamma function, namely [1, Eq. (6.1.1)], 



Thus, using (5A.6) in (5A.5), we obtain 

nT{m) Jo ( a + b/2 sin 2 0) m it Jo (1 + b/2a sin 2 0) m 

(5A.7) 

Finally, letting c = b/2a, we can rewrite (5A.7) as 



(5A.8) 
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which is identical with of (5A.1). Thus, equating (5A.8) with (5A.3) and 
(5A.4) establishes the desired results for m noninteger and m integer, respectively. 

One final note is to observe from (5A.4) that Ti(c) = [1 — fi(c)]/2. Thus, a 
special case of (5 A. 8) that is of interest on Rayleigh channels is 



1 

7t 



sin 2 0 
sin 2 0 + c 




(5A.9) 



which could also be obtained directly as follows: 
1 r ' 1 sin 2 e 



1 f n > 

n Jo 



1 f n ! 2 

e= - / 

n Jo 

_ i i ri 1 ( 

2 n Jo sin 2 ( 



9 + cJ 
dO 



Making use of the definite integral in Eq. (2.562.1) of Ref. 2, we arrive a 

i r ' 2 



i r ! 

7t Jo 



sin 2 0 + c 



-d0 = 



/ 1 _! 


(JJ+I tan fA 


y c(l + c) 


c id °) ( 



=K i -®^ p(c) 



The reason for including this alternative derivation is that it is useful in deriving 
closed-form results for two other integrals of interest related to evaluating the 
performance of QAM and M - PSK over Rayleigh channels. In particular, for 
QAM we will have a need to evaluate 



1 r*/ 4 sin 2 0 1 r/ 4 ( c 

~ — dO = — 1 5 

n Jo sin 0 + c n Jo \ sin 0 + c, 



dO 



1 1 f*/ 4 c 

/ — 5 40 

4 n Jo sin 0 + c 



(5A.12) 



Making use of the same indefinite integral as used in (5A.11) we immediately 
arrive at the desired result, namely, 



1 r' 4 sin 2 0 
n Jo sin 2 0 + c 




(5A.13) 
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1 ,(/W— 1WIW sjn 2 0 

2 . - / 5 de 

n Jo sin 6 + c 

For M-PSK, we will have a need to evaluate 



I [W-l)n/M sin 2 (9 M _ \ 

— / — ~ d6 = 

Jt Jo sin 6 + c M 

Making use of the same indefinite integral 
arrive at the desired result, namely, 



i r (k 
n Jo 



6 + c 

(5A.14) 
we immediately 



1 r(M—\)n/M sin 2 q 



n Jo 



-mi* 



1 + c (M-l)jr 



l + c (M — 1)jt [2 




For evaluation of symbol error probability corresponding to single-channel 
reception of M-PSK on Nakagami-m fading channels and also for multichannel 
reception of M-PSK on Rayleigh fading channels, we shall have need to evaluate 



K m = 



1 r(M-l)n:/M ( in 2 0 \ m 
- / —5 dd 

n Jo y sin 6 + c J 



(5A.16) 



Using a result [7, Eq. (21)] for the symbol error probability performance of 
M-PSK over a Rayleigh channel with multichannel reception, it is straightforward 
to show that for m integer, 




^ I (~ + ^n- a) £ (f) 

M n \ 1 + c ^ V 2 / f^ 0 V k J [4(1 + c)]* 

+ sin(tan— a) ^ ^ — T,k [cos (tan -1 a)] 2( * :_ ' )+1 1 (5A.17) 

k= l i=t ^ + c -* J 
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where 




and 



'( 2 f/ A 



(I) 



For m= 1, (5A.17) reduces to (5A.15). 



(5A.18) 



(5A.19) 




For evaluation of symbol error probability corresponding to single-channel 
reception of QAM on Nakagami-m fading channels and also for multichannel 
reception of QAM on Rayleigh fading channels, we shall have need to evaluate 




n 




de 



(5A.20) 



Using a result [7, Eq. (18)] with 9 V = (M + 1 )n/M and 0 L = (M — it 

is straightforward to show that for m integer, 



~r 

n Jo 



1 1 I c \ ( n * -i \ST' f 2k \ 1 

~M jt\/l+c\\2 ^SUJ[4(1 + 



c)f 



— sin(tan 1 a) — r [cos (tan 1 a)]' 

f — \ r- ' (1 + c) k 



:-»)+! | 



where a and T& are as evaluated in (5A.18) and (5A.19), respectively. Letting 
M = 4 in (5A.21) whereupon a = y/c/{ 1 + c) gives the desired result in (5A.20). 

Finally, for exact evaluation of bit error probability corresponding to single- 
channel reception of M-PSK on Nakagami-m fading channels and also for 
multichannel reception of M-PSK on Rayleigh fading channels, we shall have 
need to evaluate integrals of the form in (5A.17) or (5A.21) but with upper 
limits given by 7r[l — (2k ± 1)/M] for k = 1, 2, . . . , M — 1. What is needed to 
evaluate the bit error probabilities above is the difference of specific pairs of 
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these integrals which can be related to the generic closed-form result given by 
Eq. (18) of Ref. 7. Specifically, it can be shown that 



= t" r 9l ( 2 sm 9 2 ] d °-^- r eu ( ? n20 2 ) 

2jt Jo y sin 2 0 + n 2 L ) 2: x Jo \ sin 2 0 + m ) 



|2 0 + 0-u ) 
2 k\ 1 



+ sin (tan 1 a v ) ——^y— [cos (tan 

|=t t = 1 + Pu) 






k ) [4(1 + H 2 u)] k 
~ x ccu)? (k - i)+l | 



[4(1 + n 2 L )f 



+ sin (tan 1 a,J ^ 2 [cos (tan 1 a L )] 2(k 0+1 l (5A.22) 

*= 1 «=1 U + ^ L > ) 






sin 0 L , 


Pl ~ 

yi + Mi 


OIL = Pl cot 6 l 


- sin Oy, 




&u = Pu cot Ou 



/l +VU 



with K a constant. Our interest will be in the case where 6y = (2k + l)n/M, 
0 L = (2k — 1 )n/M and K is related to signal-to-noise ratio. Alternatively, for 
Ou = (M + l)n/M, 0 L = (M - l)n/ M, then fj, L = ~nu = y/c, fa = -fa = 
\Jc/(\ + c 2 ), and ay, = oyy = a, in which case (5A.22) simplifies immediately 
to (5A.21). 




Interestingly enough, a closed-form expression for the integral in (5A.16) or 
(5A.21) with arbitrary upper limit, say 4 >. can be obtained from (5A.22). In 
particular, setting 0 L = n — 4> and Ou = tt, whereupon the second integral in 
(5A.22) disappears, we arrive at the result 
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1 ^ 
<t>\ c)= ~ 
n Jo 

xE 



sin 2 9 + c 
2k\ 



k J [4(1 + c)f 



<EE 



(1 + cf 



--M(e 

n n V2 
) 

l |, — n < 0 < n (: 



dO = B{ ( — I- tan 1 a 

n n { " 

+ sin (tan 1 a) 



[cos(tan 1 a)] 2<k ,)+1 



sgn (/>, a = —/3cot 0 



Clearly, (5A.24) reduces to (5A.16) and (5A.21) when 0 = (M — l)n/M and 
<j) = Jt/M, respectively. 

Another closed form for the integral in (5A.24) has been suggested to the 
authors by R. F. Pawula, which is readily derived using a clever change of 
variables due to Euler and Legendre [8, p. 316]. Although this alternative 
closed form is quite similar in structure to (5A.24) and therefore does not 
offer a significant computational advantage, it is nevertheless worth documenting 
because of the elegance associated with its derivation and the simplicity with 
which the final result is obtained relative to that employed in arriving at (5A.24). 

To begin, we first employ simple trigonometry to convert the integral to a 
slightly different form as follows: 



iM\c) 



1 ft ( sin 2 9 \ ' 
nj 0 y sin 2 9 + c J 




7t 



r* f 1 — cos 29 V 
lo V 1 + 2c - cos 29 ) 



1 / 1 -cos£ V 

2tt( 1 + 2c)" ! Jo \l-rf cos^y 



dS 



d9 

(5A.26) 



where d = 1/(1 + 2c). Next, employing the Euler-Legendre change of variables 



1 — d cos § = - 



1 -d 2 



d$ = 



JT^d 1 



-dx 



(5A.27) 



1 + d cosx’ 1 + d cosx 

then after some algebraic and trigonometric manipulation, we obtain the form 
djc f Xm “ (1 - cosa:) m 



/m(0;c) = 



2 m 7t(l + c)"'-V 2 



Jo 1 



+ d cosx 



- dx 



where 



cos 20 — d (1 + 2c) cos 20 - 1 



(5A.28) 



(5A.29) 
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Finally, letting x = 2 1 and taking care to assure that x max as derived from (5A.29) 
is intepreted in the four-quadrant arctangent sense, we get the simpler integral 

f0rm r- T . 

1^,0 = -, , 1 — 2 J o 



7T( 1 + c) m_1 / 2 Jo c + COS 2 t 



where 



( l + sgnD\ 



(5A.30) 



(5A.31) 



D = (1 + 2c) cos 20- 1 



(5A.32) 



The integral form of (5A.30) is valid for m integer as well as m noninteger but 
is restricted to values of 0 [the upper limit in the integral of (5A.26)] between 
zero and n. Later, after obtaining the desired closed-form result, we will show 
how to remove this restriction. 

To obtain the closed form of (5A.30), we use the well-known geometric series 
YJk=o * k = — x m )/( \ — x) to rewrite this equation as 



7 m (0;c) = - 




(5A.33) 

where a 2 = 1/(1 + c). The first term is the original integral when m = 0 and 
thus from (5A.26) must be equal to 4>/it. The second integral is available in 
Eq. (2.513.1) of Ref. 2, namely, 



im?) 



sin[(2fc — 2j)T~\ 



(5A.34) 

Combining these two results and simplifying gives the alternative closed-form 
result 



[4(1 + c)f 

(-1 y +k sin[(2£ — 2 j)T] 
[4(1 + c)f 2k - 2 j ’ 



0 < 0 < 7 r (5A.35) 

To extend this result so as to apply for upper integration limits in the region 
r < 0 < 2k, we proceed as follows. First we partition the integral in (5A.26) as 
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In the second integral make the change of variables 0' = 0 — n. Then 




(5A.37) 

The second integral in (5A.37) can be evaluated using (5A.35) with 0 replaced by 
<j) — n. For the first integral we have to first evaluate T in the limit when 0 = n 
and then use (5A.35). Since 0 approaches n from below, it is straightforward 
to show that the first term of (5A.31) will be zero and the second term will 
approach i r. Thus, lim^* T = n. Using this value of T in (5A.35), the double 
sum evaluates to zero and hence the first integral above becomes 



1 

71 



i: 



d0= 1 






'2k\ 1 

. k J [4(1 + c)f 



(5A.38) 



Thus, when it < 0 < 2n, the final result can be written as 



Im(4>;c)= 1 — 




1 

[4(1 + c)f 



( 2k '\ 

l k ) 



[4(1 + c)] k 



2 I | ( — 1 ) k+k sin[(2k — 2j)T'] 

T ) [4(1 + c)f 2k - 2 j 



(5A.39) 



where T’ is T evaluated with 0 replaced by <p — n. However, because of the 
periodicity of T with respect to the 20 process, we have T = T. Thus, the final 
result is 






2^ / c ( 2k\ {— 1 y +k sin[(2T — 2 j)T\ 

V j J [4(1 + C)f 2k - 2 j 

7t < 0 < 2n 



(5A.40) 
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or combining this with (5A.35) 



r /JL . , <S> ( 1 + sgn(4> - n) _ T\ ! c 2k\ 1 

m 0,C » V 2 ttJ V 1 + c^U ) [4(1 + c)f 



2 I c X^X^ f 2^ \ ( — iy + ^ si n [ (2/c — 2j)T] 

' n V T+c W ; [4(1 + c)]* 2& - 2y ’ 

O<0<2 7T (5A.41) 




In the study of generalized diversity selection combining to be discussed in 
Chapter 9, we shall have need to evaluate an extension of the integral in (5A.24), 
namely, 



/ m (0;ci,c 2 ) = 




(5A.42) 



where, in general ci / c 2 . Since a closed form for such an integral cannot be 
obtained from the results of Ref. 7 nor for that matter from any other reported 
contributions, we turn once again to the method suggested by Pawula for arriving 
at the alternative closed form for /„,(</>; c) given in (5A.35), but instead apply 
it now to (5A.42). In particular, following steps analogous to (5A.26) through 
(5A.30), it is straightforward to show that 



VcT(l -d l )d 2 r T 1 / sin 2 ^ +1 V 

,Cl,Cl 7T(1 + Ci) m - l /2{di - d 2 ) Jo l^ci+cos 2 ? 

where, as before, di = 1/(1 + 2c,), i = 1,2 and now also 



dt 



(5A.43) 



D a 1 - d\d 2 - d\ + d 2 
2 (d x - di) 



(5A.44) 



In addition, T \ corresponds to T of (5A.31) with c replaced by c\. 

Now using the same geometric series manipulation as in (5A.33), we can 
rewrite (5A.43) as 



/»«>;ci,c 2 ) 



Vd(l +ci)(l 



r 



1 - (1 - af” +1) sin 2(m+1) t) 

(1 -<q sin 2 7)(1 — bj sin 2 1 ) 

(5A.45) 



n(d i -d 2 ) 




134 USEFUL EXPRESSIONS FOR EVALUATING AVERAGE ERROR PROBABILITY PERFORMANCE 



where, as before, a\ = 1/(1 + ci) and now, in addition, 

b 2 a 1 _ 2(di -d 2 ) _ c 2 -ci 

1 1 + D 1 + d\ — c?2 — d\d2 C2(l + Ci) 



(5A.46) 



Expanding the integrand of (5A.45) into a partial fraction expansion and 
evaluating the fractional coefficient in front of the integral purely in terms of 
c i and C 2 , we obtain, after considerable algebraic simplification, 



/„,(</>; ci, c 2 ) 



l_ I ci r Tl 1 - (1 - af n sin 2 '" t) ^ 
n V 1 + ci Jo I - a] sin 2 1 



I n*-( C2 

7T V 1 + ci \c 2 - ci / Jo 1 - b 2 sin 2 1 



(5A.47) 



Comparing the first term of (5A.47) with (5A.33), we see immediately that 



/ m ((/>;ci,c 2 ) = / m (0;ci)- 



I pr~ f C2 V” - ( i m&pj l 

n V 1 + ci \ C2 — ci / 7o 1 — b\ sin 2 1 



(5A.48) 

which indicates that the second term in (5A.48) accounts for the additional factor 
in the integrand of I m (<p;c\, p 2 ) that is not present in the integrand of I m (<p\c\). 

Since for c \ = C 2 , we have from (5A.46) that b\ = 0, then writing the second 
term of (5A.48) as 



■ /x(-s-V r 1 ' dl 

n V 1 + ci V C2 — ci ) Jo 1 — b\ sin - 1 



I 7 ' Sm 2 dt 

n\j 1 + ci (l + cj) m J 0 1 — (> 2 sin 2 1 




(5A.49) 



and using (5A.34), we obtain 

Try l + ci V c 2 -ci/ 7o 1 — bf sin t 

— Zi. / Cl ^2m\ 1 

“ 7T V 1 + C! UJ [4(1 + 0!)]"* 

_ ^ /2m\ (-iy’ +m sin[(2w-2j)r 1 ] 

W 1 + ci 7 7 [4(1+ Cl )r 



2m — 2 j 



(5A.50) 
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Substituting (5A.50) into (5A.48) and recognizing the form of 7 m (d>; c) in (5 A. 35), 
we immediately see that for c\ = C 2 , 

7 m (0;ci,ci) = / m+ i(d>;ci) (5A.51) 

as it should from the definition of /,„(</>; c\, c 2 ) in (5A.42). 

For the case c 1 / c 2 , we return to the form in (5A.48) and analogous to 
(5A.33) partition it into two integrals, that is, 



/ m (^;ci,c 2 ) = / m (d>;c 1 )- 



C 2 -C 1 ) |^7T V 1 + ci Jo 1 — h 2 sin 2 1 






The first integral in (5A.52) can be evaluated by first noting from (5A.47) that 
1 ft 



-dd = /i(d>;c 2 ) 




/ 0 (d>;ci,c 2 ) = 



7T It V 1 + Cl Jo 1 - sin 2 1 
Evaluating / 1 (0; c 2 ) from (5A.35) as 

<t> t 2 r 



Ii(4>\c 2 ) = 



n n V 1 + c 2 



where T 2 now corresponds to T of (5A.31) with c replaced by c 2 , then combining 
(5A.53) and (5A.54), we get 



The second integral of (5A.52) is evaluated as before using (5A.34). Without 
further ado we present the desired closed-form result for 7 m (0; c\ , c 2 ), which is 




(2k\ 



1 



n V 1 +C 1 \c 2 -ci) V k ) [4(1 + c x )t 
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(-1V+* sin[(2fc — 2j)T\] 
X [4(1 + c\)] k 2k — 2j 



(5A.56) 



To extend the range of coverage of the upper integration limit from 0 < 0 < n 
to 0 < 0 < 2n, we proceed as before and arrive at the final desired result: 



7 m (0;ci, c 2 ) 



/ 1 + sgn(0 - jt ) 

V 2 




ci - Cl ) 




(-1V+* sin[(2k-2 j)T 1 ] 
[4(1 + ci)] fc 2k — 2j 



0 < 0 < 2 n 



(5A.57) 



where now 7 m (0;ci) is evaluated from (5A.41). 




An extension of the preceding integral wherein each of the two factors in the 
integrand is raised to an arbitrary power is of interest in the study of diversity 
(optimum) combining in the presence of interference (see Chapter 10 for a 
complete discussion of this topic). Unfortunately, it appears difficult to apply 
the previous derivation approaches to obtain a result for the most generic form 
of this integral, where the powers are not necessarily restricted to be integer 
and the upper limit of the integral is arbitrary. However, for the case where the 
upper limit is equal to 7r/2 and the powers are restricted to be integer, which is 
of interest in evaluating the average error probability performance of PSK with 
optimum combining over a Rayleigh fading channel, making an association with 
a closed-form result obtained by Villier [9], we present (without derivation) the 
following result: 
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where 1 



and 



1 r/ 2 / sin 2 0 y 
Jt Jo y sin 2 0 + c x ) 



( sin 2 0 \ mz 

y sin 2 0+ C 2 J 



d0 



0 Cl/ClT 2 






' 2(1 - d/c 2 ) m ‘ 



B k = 



A* 

( mi + m 2 - 1 V 

V * J 




4fc=(-l) m2 - 1+ * 



(V) 

(m 2 - 1)! 



(mi+m 2 -n) 

iX+i 



hie) = 



(2 n - 1)!! 
n!2»(l +c)» 



(5A.58) 



(5A.59) 



(5A.60) 



with the double factorial notation denoting the product of only odd integers from 1 
to 2k - 1. It is straightforward (although requiring some tedious manipulations) 
to show that (5A.58) reduces to (5A.56) when mi = m and m 2 = 1. Also, by 
symmetry it can be shown that (5A.58) reduces to (5A.56) with ci and c 2 switched 
when mi = 1 and m 2 = m. 



a. i r 

n Jo 



-dO 



c + sirri 

Yet another integral that arises in the study of generalized diversity selection 
combining to be discussed in Chapter 9 is 






•;c) = - r 

n Jo 



sin 2m 0 



-dO 



(5A.61) 



'Note that by convention, ( n ) =0 for n > k. Also, for m 2 = 1, by convention the product 
n m Li ( m l + m2 — n) = 1 and the only nonzero- valued coefficients are Aq = Bq = C k = 1. For 
m 2 > I , the coefficients A/,, B^, and C k clearly depend on both m\ and /n 2 . 
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This integral is similar in form to (5A.30) and can be evaluated by following an 
approach analogous to that used in arriving at the closed form in (5A.35). The 
procedure is as follows. Let a 2 = 1 /c. Then 

1 a 2 f (l> a 2m 



[ a f ! dG 

na 2m J 0 l + a 2 sin 2 9 
1 r * 1 - (1 - a 2 
7 ra 2(m ~ l) Jo 1 + a 2 i 



1 \ r* 1 ft 1 - a 2m sin 2m 0 1 

= — — - / -d9- —d0\ (5A.62) 

n a 2 ^ [Jo \ + a 2 sin 2 0 Jo 1 + a 2 sin 2 0 \ 

For / odd, ]T^ =0 (—I ) l x‘ = (1 —x l+l )/(\ + x). Thus, letting x = a 2 sin 2 0, then 
for m even we get 

c) = — J — - [ I' 1 ’ — — d9 - V (— 1 )'a 2 ' /tin 2 ' 9 del (5A.63) 

Jta 2 ^ [Jo l + a 2 sin 2 9 ^ Jo \ 

Finally, using Gradshteyn and Ryzhik [2, Eq. (2.562)] to evaluate the first 
integral, that is, 

/ d9 = tan~* (\/l + a 2 tan0) (5A.64) 

Jo 1 + a 2 sin 2 0 VT+^ K ’ 

and (5 A. 34) for the second integral, we arrive at the desired result (for m even) 

c) = {/-/— lan ' ( J —— tan^ -^(-i)'/ 

n [V 1 + c yVc ) i^o c 






(5A.65) 

For m odd we slightly change the procedure. First rewriting (5A.62) as 

1 /^-l + (l+a 2m sin 2m 0) 

J m (4>\c)= — - — - / ~ d9 

na 2(m ~ > Jo 1 + a 2 sin 2 9 

1 r r* 1 ft 1 + a 2m sin 2m 9 1 

na 2( m 1) J 0 1 -|- a 2 s j n 2 0 J 0 1 + a 2 s j n 2 Q 
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then noting that for / even, ^[ =0 (— l)'x ! = (1 +x ,+1 )/(l + x), we obtain 

(5A.67) 

which is the negative of (5A.63). Thus, for arbitrary integer m, we have 

7 m (0;c) = (— l) m - { \/j-— tan -1 (t/^-^tan^^j 

T [Vl+C yVc y Jgj c‘ 

0 / 2 A , / 2* \ sinLC 2 * - 2 7)0]1\ 

X ^(/j + 2^-g ( - 1>J U 2i — 2j ]} 

(5A.68) 

A special case of interest is when 0 = n/2, in which case (5A.68) simplifies to 

^O-HTt ( i )] <5A ' 69) 

which reduces to (5A.9) when m= 1, as it should. 
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NEW REPRESENTATIONS OF 
SOME PDF’s AND CDF’s 
FOR CORRELATIVE FADING 
APPLICATIONS 



Later in the book we shall have reason to study the performance of digital 
communication systems over correlative fading channels. Such channels occur, 
for example, in small terminals equipped with space antenna diversity where 
the antenna spacing is insufficient to provide independent fading among the 
various signal paths. In such instances, the received signal will consist of two or 
more replicas of the transmitted signal with fading amplitudes that are correlated 
random variables. To assess the performance of receivers of such signals, it is 
therefore necessary to study the joint statistics of correlated random variables 
with probability distributions characterized by the various fading channel models 
of Chapter 2. 

One important application of the above scenario pertains to a system 
wherein the channel is assumed to be modeled by two paths and the receiver 
thus implements a diversity combiner with two branches. Evaluation of the 
performance of such a dual diversity combining receiver (discussed in great detail 
in Chapter 9) requires, in general, knowledge of the two-dimensional (bivariate) 
fading amplitude PDF and CDF. For the specific case of selection combining 
(SC) [1, Sec. 10-4], the combiner chooses the branch with the highest signal- 
to-noise ratio (or equivalently, with the strongest signal assuming equal noise 
power among the branches) and outputs this signal to the threshold decision 
device. To evaluate performance in this instance, it is sufficient to obtain the 
one-dimensional PDF and CDF of the SC output, which is tantamount to finding 
the PDF and CDF of the maximum of two correlated fading random variables. 
The SC output CDF is used to evaluate outage probability (the probability that 
neither SC input exceeds the detection threshold, or equivalently, the probability 
that the SC output falls below this threshold), while the SC output PDF is used 
to evaluate average error probability. 
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In what follows we focus on the Rayleigh and Nakagami-m fading channels 
since they are the most commonly used in digital communication system analyses 
and, as discussed previously, are typical of many wireless environments. 



6.1 BIVARIATE RAYLEIGH PDF AND CDF 



From a purely mathematical standpoint, the bivariate Rayleigh and Nakagami-m 
distributions can be viewed as the joint statistics of the envelopes, Ri and Ri, 
of two correlated chi-square random variables of degree 2 and 2m, respectively. 
Specifically, the bivariate Nakagami-m PDF is given by [1, Eq. (126); 3, Eq. (1)] 



Pr,,r 2 (n, £2i \r 2 , £22 1 m, p) 

4m m+1 (rir 2 ) m 



-exp - 



1-p l £2] 



where £2,- = rf,i = 1,2 and p = cov(rJ\ r|)/-^/var(rj ) var(r|) is the correlation 
coefficient (0 < p < 1). The special case of the bivariate Rayleigh PDF is given 
by [2, Eq. (122); 4, Eq. (3.7-13)] 



PRi,R 2 ( r i, £2i;r 2 , £2 2 |p) = 



£2i £2 2 (1 — p) 

( V pnr2 



1 

exp I-- l 7T“ + FT 



V(l-p)V^£2T 



1- P \£2i ^2 

ri,r 2 >0 (6.2) 



Tan and Beaulieu [3] were successful in finding infinite series representations of 
the CDFs corresponding to (6.1) and (6.2), in particular, 



P Sli R 2 (ri, £2i;r 2 , £2 2 |m, p) 

_ (1 - p) m k y{m + k,mr\/Q.x{\ - p))y{m + k,mrl/Q. 2 {\ - p)) 
~ T(m) f^ P k\T{m + k) 



where y(a, x) = f ( * e ‘t a 1 dt, Re{a} > 0 is the incomplete gamma function [5, 
Eq. (6.5.2)] and 

P«,,« 2 (n > £2i;r 2 , £2 2 |p) 

= (l-p)y'/f lk+l, I p(k+l, 

h V ^(l-p)) \ £2 2 (1 — p) 



(6.4) 
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where P(a, x) = (l/r(o:)) e~‘t a ~ ] dt, Re{a] > 0 is another common form of 

the incomplete gamma function [5, Eq. (6.5.3)]. Although (6.3) and (6.4) appear 
to have a simple structure, they have the drawback that because they are infinite 
series of the product of pairs of integrals, their computation requires truncation of 
the series. Bounds on the error resulting from this truncation along with empirical 
results for indicating the rate of convergence and tightness of the ensuing bounds, 
are discussed in Ref. 3. Tan and Beaulieu [3] go further to point out that the 
complementary Rayleigh bivariate CDF (and thus also the Rayleigh bivariate 
CDF itself) had previously been expressed in terms of the Marcum g-function 
[1, App. A], that is, 



PR t ,R 2 (ri, ;r 2 , ft 2 | p) 



- Pr{Ri > r,} 


- Pr{/? 2 


> r 2 ] + Pr{Ri > 


r l ,R 2 > r 2 ] 


( r\ \ 




2 r 2 f 


2p n \ 




i-pVnT V 1 


- p^hj 




i-gi 


( 1 2 p r 2 


2 ri 


exp NJl 


i -p^m' 


V i - p 



(6.5) 



Although Tan and Beaulieu [3] abandoned this result because of the lack 
of availability of the Marcum g-function in standard distributions of such 
mathematical software packages as Maple V, MATLAB, and Mathematica, Simon 
and Alouini [6] recognized the value of (6.5) in terms of the desired form 
of the Marcum g-function as described by (4.16) and (4.19). Indeed, as we 
shall soon see, this desired form of the Marcum g-function allows the bivariate 
Rayleigh CDF to be similarly expressed as a single integral with finite limits 
and an integrand that includes a type of bivariate Gaussian PDF. This resulting 
form is simple, exact, and requires no special function evaluations (i.e., the 
integrand is entirely composed of elementary functions such as exponentials and 
trigonometries). 

Since the Marcum g-function as represented by (4.16) and (4.19) depends on 
the relative values of its arguments, we must consider its use in (6.5) separately 
for different regions of the arguments r\ and r 2 . For simplicity of notation, we 
shall also introduce the normalized (by the square root of the average power) 
envelope random variables K, = i = 1,2. 

Consider first the region of r\ and r 2 such that 



£2 2 (1 - P) 



or, equivalently, T 2 < JpY \ which corresponds to the first argument being less 
than the second argument in the first Marcum g-function in (6.5). Since in this 




144 NEW REPRESENTATIONS OF SOME PDF’s & CDF’s FOR CORRELATIVE FADING APPLICATIONS 



region we would also have % fpY 2 < Y then in the second Marcum Q-function 
in (6.5), the first argument is also less than the second argument. As such, we 
now substitute (4.16) in both of these two terms. After much simplification, one 
arrives at the desired result, namely, 



PRuRiin, town, £2 2 | p) = 1 - exp(-y^) 






Y\ + Y 2 2 + 2JpY x Y 2 sin# 
1 ~P 



(1 - p 2 )Y 2 Y 2 

+ yfp(l~ P)Y\Y 2 {Y\ + Yl) sin# ^ 

(py2 + 2 ^pF 1 F 2 sin#+y2) 

x (Y\ + 2 y /pY l Y 1 sin #4. pY%) 

(6.6) 

The complement of the region just considered is where Y 2 > yfpY x or 
equivalently, *J~pY 2 > pY Here, however, we can have either JpY 2 > Y] or 
pTi < yfpY 2 < T| . Thus, two separate subcases must be considered. For the 
first subcase where yfpY 2 > Ti, we would certainly also have yfpY 2 > pY\ 
and thus for both Marcum Q-function terms in (6.5), the second argument 
is greater than the first argument. Thus, substituting (4.19) in both of these 
terms, we obtain after much simplification the identical result of (6.6) except 
that the second term, namely, exp (— F 2 ), now becomes exp(— Y\). Finally, for 
the second subcase where pFi < yfpY 2 < Y \, once again (6.6) is appropriate 
with, however, the second term, exp(— F 2 ), now replaced by exp(— Y\) + 
exp(— T 2 ). 

What remains is to evaluate the bivariate Rayleigh CDF at the endpoints 
between the regions where one must make use of the relation in (4.17). When 
this is done, the following results are obtained for the second term in (6.6). 
When Y 2 = JpY u use ^ expl-F^) + expj-pF^) and when Y x = JpY 2 use 
\ exp(— F 2 ) + exp(— pF 2 ). Summarizing, the bivariate Rayleigh can be expressed 
in the form of a single integral with finite limits and an integrand composed of 
elementary functions as follows: 



Pr u r 2 (tu nnn. n 2 | p) = 1 - s(ri, y 2 Ip) 

+ J_ £ e::p ^ Y \ + Y\ +^y/pY\ Y 2 sin# ^ 

(1 - p 2 )Y\Y\ 

+ Jp(l-p)Y 1 Y 2 (Y 2 l + Y 2 2 ) sin# 

(pF? +VpF x F 2 sin# + F*) 
x(F? +2JpY x Y 2 sin# + pYf) 

Yi = rt/y/Sk 



(6.7) 
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where 



g(Y x ,Y 2 \p) = 



exp (-Yj), 

2 exp(— Ky)-|- exp(— pFy), 
exp(— Fj) + exp(— F§), 
iexp(-y|5+ e xp (-pY 2 2 ), 
exp(— Fj), 



0<Y 2 <^/pY 1 
Y 2 = y fpY l 

ypFi < F 2 < Fj/^P (6.8) 
F 2 = Yi/Jp 
Fi/^/P < y 2 



At first glance, one might conclude from (6.8) that the bivariate CDF as 
given by (6.7) is discontinuous at the boundaries F 2 = yfpY \ and F 2 = Fi/^/p. 
Clearly, this cannot be true since the Marcum O-function itself is continuous over 
the entire range of both of its arguments and thus from the form in (6.5), the 
CDF must also be continuous over these same ranges. The explanation for this 
apparent discontinuity is that the integral portion of (6.7) is also discontinuous 
at these same boundaries but in such a way as to compensate completely for the 
discontinuities in g(Y x , F 2 |p) and thus produce a CDF that is continuous for all 
positive Yi and F 2 . 

The bivariate Rayleigh CDF of (6.7) has been evaluated numerically using 
Mathematica and compared with the double-integral representation [3, Eqs. (1) 
and (2)], the infinite series representation [3, Eq. (4)] and (6.5) using direct 
evaluation of the Marcum ^-function. Both the infinite sum and the proposed 
integral representation have a significant speed-up factor compared to the other 
two methods (double-integral approach and the one where Marcum-0 is evaluated 
numerically). Furthermore, the proposed approach always gives the exact result 
(up to the precision/accuracy allowed by the platform), whereas the infinite series 
representations (when programmed with the available Mathematica routines and 
setting the upper limit to infinity as allowed by Mathematica) loses its accuracy 
for high values of p such as 0.8 and 0.9 and a truncation of the series is required. 1 
Note that the number of terms for the truncation must be determined for each 
set of values of r\, r 2 and p. Tan and Beaulieu [3] derived a bound on the 
error resulting from truncation of the infinite series but reported that this bound 
becomes loose as p approaches 1, which we have verified is the case. 

An alternative simple form of the bivariate Rayleigh CDF can be obtained by 
substituting the representations of the first-order Marcum g-function of (4.26) 
and (4.27) in (6.5). When this is done, then after considerable algebraic 
manipulation the following result is obtained: 



P Rl ,R 2 (n, ^i-,r 2< n 2 \ p) = 1 - g(Y u F 2 |p) + sgn(F 2 - ^pY 1 )I(Y l , Y 2 \p) 

+ sgn(F!- VpF 2 )/(F 2 ,F,|p) (6.9) 

1 Note that the infinite series representation itself converges to the correct result for all values of p 
between zero and one. It is the limitation of the numerical evaluation of this series caused by the 

software used to make this evaluation that results in the loss of accuracy for large p. 
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where analogous to (6.8), 

f exp (—3^), 0 < Y 2 < ^/pY i 

g(Y i, Y 2 \p) = l exp(-F?) + exp(-F2), jp Yl <Y 2 < YJ^p (6.10) 
( exp(— Fj), Y x IJp < Y 2 

and 

,<7 - = i /> f [ y; + } 

( 6 . 11 ) 

Note that the compensation for the discontinuities in g(Fj . Y 2 \p) at the boundaries 
Y 2 = ^fpY i and Y 2 = F| / ^fp is now immediately obvious from the form of the 
last two terms in (6.9). Moreover, the values of the CDF at these endpoints are 
given as 

1 



1 f* / L 2,1 *1(1 - P 2 ) 2 1 \ 

i(-, eip rr ,+ H; i+z^smg+^ j } • 



r 2 = VpY i 

and 

Pri^u ^ 2 Ip) = 1 - ^exp(-F^) - exp(— Fj) 



1 r i U , 1 *Sa - p 2 ) 2 1 1 

S X, “ P \ - [ y ‘ + — l + 2psin0+^ J | • 



47T 
= VpYl 



One might anticipate that the bivariate Nakagami-m CDF could be expressed 
in a form analogous to (6.5), depending instead on the mth-order Marcum Q- 
function. If this were possible, then using the desired form of the generalized 
Marcum Q-function as in (4.42) and (4.50), one could also express the bivariate 
Nakagami-m CDF in the desired form. Unfortunately, to the author’s knowledge 
an expression analogous to (6.5) has not been reported in the literature and the 
author’s have themselves been unable to arrive at one. 



6.2 PDF AND CDF FOR MAXIMUM OF TWO RAYLEIGH RANDOM 
VARIABLES 

In this section we consider the distributions of the random variable R = 
max(/?i, R 2 ), where R\ and R 2 are correlated Rayleigh random variables with joint 
PDF as in (6.2). As mentioned previously, the random variable R characterizes 
the output of an SC whose inputs are R\ and R 2 . Since Pr{/? < R*} = Pr{P| < 
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R*,R 2 < R*}, the CDF of R is obtained immediately from the joint CDF of 
Ri,R 2 by equating its two arguments. Since we are ultimately interested in the 
PDF of the instantaneous SNR per bit, 2 y = r 2 Eb/No with mean y = r 2 Eb/No = 
£2Eb/No, it is convenient for the Rayleigh case to start by renormalizing the 
bivariate CDF of (6.7). 3 Thus, noting that Y 2 = rf/Eli = Yi/Yn * = 1, 2, the joint 
CDF of yi and y 2 is given by 

p n'Yi(Yi’YuYi,Yk\$ = 1 - g ( h (Yu y x ),H(y 2 , y 2 )\p) 




+ yfp( 1 - P)‘ 



G(H(y l ,y 1 ),H(y 2 ,y 2 )\p) = 



P*)M M 

\Y\ / \ YiJ 

'*) (£) (%+£)«n0 

.YiJ KYiJ \Yi YiJ 



Pzr + 2, 
Y i 



(*-)(*) sind+^l 

\YiJ \YiJ YiJ 



(2) (^sinO + p^) 
\YiJ \YiJ YiJ 









(6.14) 


H(Y2, y 2 ), 


0 < 


Y2 


Y i 


\h(y4%) + 


n _ 
Y2 


- pi 1 

Y t 




H(Yi’Yi) + H(y 2 , y 2 ), 


pI ± 




< - — 




Y i 


Y2 


PYi 


(y 7 ,y 2 ) + H 


Y2 _ 


- 1 21 




2 


Y2 " 


PYi 




H(yuy i), 


}_Yl 


.<M 





2 As in Chapter 5, we do not distinguish between bit and character instantaneous SNR. Thus, the 
results derived here apply equally to the instantaneous SNR per symbol when relating to digital 
communication systems with modulations that are higher order than binary. 

3 We shall use the form of the CDF in (6.7) rather than that in (6.9) because of its synergy with the 
corresponding results for correlated Nakagami-m RVs discussed in the next section. 
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with H (yi, Yi) = exp(— y,/F ( ), i = 1, 2. Defining the instantaneous SNR per bit 
at the SC output by y = max(yi, y 2 ), the CDF of y, namely P y (y), is obtained 
immediately by substituting y x = y 2 = y in (6.14), that is, 4 



Py(Y)= I - G(H(y, Y\)-H(y, Yi)\p) + ^ J exp jp y Y 1 + Y i_ 

x T (1 - p 2 )Y\ Yi + Vp( 1 ~ P)VFi K2(Xi + Yi) sin # 1 ^ 

[ (PYI + ^PY\ Yi sin# + Ft) ( Yi + V PY\ Yi sin# + pFi) \ 



= 1 - G(exp(-y/y!), exp(-y/y 2 )|p) + 



hi: 



where 



exp[- y& 1 (#|p)]ft 2 (#|p)£/# 
(6.16) 



M#lp) = 



M#lp) = 



Y 1 + Y 2 + 2 s/PYi y 2 sin# 

Ft Yi( l ~ P) 

(1 - p 2 )Yi Y 2 + y/p{ 1 ~ p)VFi Yi(Y 1 + Yi) sin# 
(py 2 + 2VpFi F 2 sin 0 + Ft) (/2 + VpFi F 2 sin 0 + PFi) 



(6.17) 



To obtain the PDF of y, we differentiate (6.16). Since the dependence y in 
(6.16) is purely exponential, it is a simple matter to arrive at the result, namely, 

Py(Y) = -G\H(y, Yi), H(y, F 2 )Ip) 

+ J n [— Ai(#|p)] exp[— y hi( 6 \p)]h 2 ( 6 \p) dO 

= G(-H'(y,YiI -H'(y.Y 2 )\P) 

+ ^ f [- h i(d\p)]exp[-Yh(e\p)] h 2(9\p) d e (6.18) 

where the prime denotes differentiation with respect to y and thus —H'(y, F;) = 
(1/F,)exp(— y/F,), i = 1,2. Note that the dependence of p y (y) on y is also 
purely exponential and as such resembles the behavior of the instanta- 
neous SNR per bit corresponding to a single Rayleigh RV, namely, p y (y) = 
(1/F)exp(— y/F). Because of this similarity, it is possible to draw an analogy 
with results for the average error probability performance of single-channel (no 
diversity) digital modulations transmitted over a Rayleigh fading channel (see 

4 Note that when y\=y 2 = y, as will be the case for the SC output PDF and CDF, the five regions 

of validity for G(», *1,0) of (6.15) are independent of y and become (1) 0 <y\< py 2 , (2) ~y x = py 2 , 
(3) py 2 < 7 i < Y2/P’ ( 4 ) Ft = Y2/P’ and ( 5 ) Y2/P < Yv 
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Chapter 8) which make use of the integrals developed in Sections 5.1.1 and 5.2.1 
based on the desired forms of the Gaussian and Marcum Q-functions. However, 
because of the additional integration on 0 required by the second term in (6.18), 
the functional form of the results will be somewhat different. 



6.3 PDF AND CDF FOR MAXIMUM OF TWO NAKAGAMI-m RANDOM 
VARIABLES 

As mentioned in Section 6.1, the alternative representation of the Marcum 
O-function discussed in Chapter 4 is not helpful in simplifying the bivariate 
Nakagami-m CDF in the form of a single integral with finite limits as was 
possible for the Rayleigh case; thus, the method used to arrive at the CDF 
and PDF of the SC output in Section 6.2 cannot be used here. Fortunately, 
however, Fedele et al. [7] were able to arrive directly at an expression for the 
SC output PDF in terms of the mth-order Marcum (7- function directly from the 
defining expression for the bivariate Nakagami-m CDF as in (6.3). Using the 
alternative representation of the generalized Marcum O-function given in (4.42) 
and (4.50), Simon and Alouini [8] were then able to simplify the expression 
for the SC output PDF and working backward (i.e., integrating rather than 
differentiating), obtain the SC output CDF. Following this approach, one never 
needs to find the joint CDF of the SC input. While it is true that the results 
from Ref. 7 could also be used to obtain directly the PDF and CDF of the SC 
output for Rayleigh fading by considering the special case of the Nakagami-m 
distribution corresponding to m = 1, the method used in Section 6.1 for solving 
the Rayleigh case allows for additional simplifications of the resulting expressions 
for outage probability and average error probability, as will be demonstrated later 
in the book. 

The PDF of the SC output R = max(/?| , R 2 ) can be found directly from the 
bivariate Nakagami-m PDF of Rt and Rj as 

pR (r) = ^ j J P filiS2 (ri, ^i;r 2 , Q. 2 \m, p)drx dr 2 (6.19) 
Substituting (6.3) in (6.19) results in [7, Eq. (20)] 



PR(r ) = 



2 m m r 2m - 1 
r(m)G7 




2 rn m r 2m ~ 1 ( mr 2 ' 

+ T(m)af exp V 



-a. 



2mP r 1 


1 2m V 


(1 - P)«i ’ V 


(1 -p)Q 2 r J_ 


1 2m p 


J ^ r) 


V (1 - P)^2 r? 


V (1 — p)S2i J 



r > 0 



( 6 . 20 ) 
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which when rewritten in terms of the instantaneous SC output instantaneous SNR 
per bit, y, becomes 



/ Imp f Y\ 2m f y~\ 
\] i-PVKi/ V 1_ PVY 2 J 



/ 1 -P\YiJ V l ~P\Y\) 



Y > 0 (6.21) 



Applying the alternative representation of the generalized Marcum ^-function ti 
(6.21), then analogous to (6.18) we obtain for 0 5 : 



p r (y) = G(-H'(y, y x ,m), -H'{y, y 2 , m)\p) 



Y m ~' e: 

o 2 nLJ 



exp[-myhi(9\p)]h(d\p)dd, y> 0 



Also, h\(0\p) is still given by (6.17), which is independent of m and 



— Y\ cos[(n? - 1)(6» + tt/2)] + J PY\ Yi cos[m(0 + n/2)\ 
PYi + 2-s / PYi y 2 sin# + y l 



'y 2 cos [(m - 1)(# + 7 t / 2 )] - VPKi Yi cos \m(9 + tt/2)]' 
Yi + 2V PYi Yi sin 9 + PYi 



5 Note that the alternative representation of the generalized Marcum Q-function (m / 1) is valid only 
for p # 0. 
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Note that m = 1, (6.24) simplifies ti 



1 


Ki + VPKi Yi sin6» j 


1 1 
+ — 


Y2 + VPY1 Yi sin9 ] 


Yi 


[py 2 + 2vWi K 2 sin6> + y, J 


Yi \ 


LYi + 2V pyi y 2 sin 6> + pyj J 
(6.25) 



which can be shown to be equal to h\(0\p)h 2 (O\p) with h 2 (0\p) obtained from 
(6.17). Thus, also noting that — //'(y, y ; , 1) = (l/y,.)exp(— y/y ; ), i = 1,2, the 
PDF of (6.24) reduces to (6.18), as it should. 

Note here that the dependence on y of p Y (y) in (6.22) resembles the behavior 
of the instantaneous SNR per bit corresponding to a single Rayleigh RV, 
namely, p Y (y) = [m m y' n ~ 1 /y"‘ T (m)J exp(— my/y). Because of this similarity, it 
is possible to draw an analogy with results for the average error probability 
performance of single-channel (no diversity) digital modulations transmitted over 
a Nakagami-m fading channel (see Chapter 8) which make use of the integrals 
developed in Sections 5.1.4 and 5.2.4 based on the desired forms of the Gaussian 
and Marcum ^-functions. However, because of the additional integration on 9 
required by the second term in (6.18), the functional form of the results will be 
somewhat different. 

The CDF of the SC output can now be found directly by integration of (6.22) 
with the result (for p^O) 

P Y (y) = G(—H (y, Yu m), -H(y, y 2 , m)\p) 

- / {Jo y m ~ l ex vt- m y hi ( 9 \p^ d y} f^ de 



T(m)2a ^ ' 

= G(-H(y, y,, m), -H(y, y 2 , m)|p) 



(hi(0|p))- m [-H(y, hj\9\p), m)]h(9\p) d9 (6.26) 



-H(y, y r m)= -H'(y, %, m)dy 



= l-exp 



i=l,2 (6.27) 



For p = 0, the PDF y can be obtained from Fedele et al. [7, Eq. (20)], which 
after some changes of variables becomes 

My >= -afi- (-=*) h - 

r(m)r, \rJ 1 r, > [ r (m) J 

+ y>0 

r(m)y 2 \y 2 J y 2 J [ T{m) \ 
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where T(m, x) = e~ l t m ~ x dt is the complementary incomplete gamma func- 
tion [5, Eq. (6.5.3)]. For m integer T{m,x) has a closed-form expression [9, 
Eq. (8.352.2)] and (6.28) simplifies to 



Py(v) = 7 



— exp [~H(y, y 2 , m)] 



(m- 1 )\y 2 \y 2 J 



exp Yu m$c 



(6.29) 

The corresponding CDFs are obtained by integration of (6.28) and (6.29) between 
0 and y. For m noninteger, integration of (6.28) does not produce a closed-form 
result, whereas for m integer, integration of (6.29) results in 



Py(Y) = ~H(y, Y\. m) — H(y, y 2 , m ) 

(" + m - D! CF l T(y 2 r + C Yi) m (Y 2 ) n \_ R ( Y1Y2 \1 
n\(m — 1)! (Yi + Y 2 ) n+m l "I Yi+Y 2 ’ )\ 

(6.30) 

where analogous to (6.27), 

(6.31) 



Note that -H 0 (y, y, m) is equal -77 (y, y, m) of (6.27). 
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OPTIMUM RECEIVERS FOR 
FADING CHANNELS 



As far back as the 1950s, researchers and communication engineers recognized 
the need for investigating the form of receivers that would provide optimum 
detection of digital modulations transmitted over a channel composed of a 
combination of AWGN and multiplicative fading. For the most part, most 
of these contributions dealt with only the simplest of modulation/detection 
schemes and fading channels (i.e., BPSK with coherent detection and Rayleigh 
or Rician fading). In some instances, the work pertained to single-channel 
reception, while in others multichannel reception was considered. Our goal in 
this chapter is to present the work of the past under a unified framework 
based on the maximum-likelihood approach and also to consider a larger 
number of situations corresponding to more sophisticated modulations, detection 
schemes, and fading channels. In addition, we treat a variety of combinations of 
channel state knowledge relating to the amplitude, phase, and delay parameter 
vectors associated with the fading channels. In many instances, implementation 
of the optimum structure may not be simple or even feasible and thus a 
suboptimum solution is preferable and is discussed. Also, evaluating the error 
probability performance of these optimum receivers may not always be possible 
to accomplish using the analytical tools discussed previously in this book or 
anywhere else for that matter. Nevertheless, it is of interest to determine in 
each case the optimum receiver since it serves as a benchmark against which 
to measure the suboptimum structure, which is simpler both to implement and 
to analyze. 

We begin our discussion by reviewing the mathematical models for the 
transmitted signal and generalized fading channel as introduced in previous 
chapters. In particular, consider that during a symbol period of T s seconds the 
transmitter sends the real bandpass signal 1 

1 Without any loss in generality, we shall assume that the carrier phase, 9 C , is arbitrarily set equal to 
zero since the various paths that compose the channel will each introduce their own random phase 
into the transmission. 
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sdt) = Re{5*(r)} = Rc {SkiDe^ 1 } (7.1) 



where Sk(t) is the k\h complex bandpass signal and ,$7 (l) is the corresponding 
kth complex baseband signal chosen from the set of M equiprobable message 
waveforms representing the transmitted information. At this point, we do not 
restrict the signal set {^(t)} in any way (e.g., we do not require that the signals 
have equal energy), and thus we are able to handle all of the various modulation 
types discussed in Chapter 3. 

The signal of (7.1) is transmitted over the generalized fading channel which 
is characterized by L p independent paths, each of which is a slowly varying 
channel which attenuates, delays, and phase shifts the signal and adds an AWGN 
noise source. Thus the received signal is a set of noisy replicas of the transmitted 
signal, that is, 2 

r t (t) = R e{a,s k (t - x t )e J0 ‘ + h,(t)} 

= R e{a,S k (t - xi)e j(2nf ‘ l+ei) + Ni{t)e jl7tfct } 

= Re{r;(r)} = R Q{R l {t)e i2nfct }, l = 1, 2, . . . , L p (7.2) 

where {A7(l)}f= j is a set of statistically independent 3 complex AWGN processes 
each with PSD 2N/ watts/Hz. The sets , {0;}^, , and are the random 

channel amplitudes, phases, and delays, respectively, which because of the slow- 
fading assumption, are assumed to be constant over the transmission (symbol) 
interval T s . Also, without loss of generality, we take the first channel to be the 
reference channel whose delay ti = 0 and assume further that the delays are 
ordered (i.e., t\ < xi < • • • < x Lp ). 

The optimum receiver computes the set of a posteriori probabilities 

p( s k(t)\{ r i(t)}iLi)’ k = 1,2, ,M, and chooses as its decision that message 

whose signal s*(f) corresponds to the largest of these probabilities. 4 Since the 
messages (signals) are assumed to be equiprobable, then by Bayes rule, the 
equivalent decision rule is to choose s*(f) corresponding to the largest of the 
conditional probabilities (likelihoods) p({r;(r)} / ^ 1 |^(t)), k = 1,2 , ,M, which 
is the maximum-likelihood (ML) decision rule. Using the law of conditional 

2 In deriving the various optimum receiver configurations, we assume a “one-shot” approach (i.e., a 
single trai on) wherein intersymbol interference (ISI) that would be produced by the presence 
of the path delays on continuous transmission is ignored. 

3 It should be noted that Turin [1] originally considered optimal diversity reception for the more 
general case where the link noises (as well as the link fades) could be mutually correlated; 
however, the noises and fades were statistically independent. Later, however, Turin [2] restricted 
his considerations to link noises that were white Gaussian and statistically independent. (The link 
fades, however, were still allowed to be correlated — statistically independent and exponentially 
correlated fades were considered as special cases.) 

4 The receiver is assumed to be time-synchronized to the transmitted signal (i.e., it knows the time 
epoch of the beginning of the transmission). 
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probability, each of these conditional probabilities can be expressed as 5 

JJJ p{{ri(t)}£ iM4 {«/}['! , mtv (r/}f't) 

x {t ,}ti)d{a,}tid{Oi}ti dKntu (7.3) 

and as such depends on the degree of knowledge [amount of channel state infor- 
mation ( CSI )] available on the parameter sets {ai}f u {6i} t f j, and {t/} /= (| . For 
instance, if any of the three parameter sets are assumed to be known (e.g., through 
channel measurement), the statistical averages on that set of parameters need not 
be performed. In the limiting case (to be considered shortly) where all parameters 
are assumed to be known to the receiver, none of the statistical averages in (7.3) 
need be performed, and hence the ML decision rule simplifies to choosing the 
largest of />(fa(0}f=ik(0, {a*}f=i> WifiL i> {*/}f=i), k = 1, 2, . . . , M. 

Receivers that make use of CSI have been termed self-adaptive [3] in that the 
estimates of the system parameters are utilized to adjust the decision structure, 
thereby improving system performance by adaptation to slowly varying channel 
changes. We start our detailed discussion of optimum receivers with the most 
general case of all parameters known since the decision rule is independent of 
the statistics of the channel parameters and leads to a well-known classic structure 
whose performance is better than all others that are based on less than complete 
parameter knowledge. Also, since detection schemes are typically classified based 
on the degree of knowledge related to the phase(s) of the received signal, ideal 
coherent detection implying perfect knowledge falls into this category. 



7.1 CASE OF KNOWN AMPLITUDES, PHASES, AND DELAYS: 
COHERENT DETECTION 

Conditioned on perfect knowledge of the the amplitudes, phases, and delays, 
the conditional probability /?({r/ (r)} / ^ 1 |^*(r), {a/}*? |, {#/};/ p [t/ };'',) is a joint 
Gaussian PDF which because of the independence assumption on the additive 
noise components can be written as 

p{{r,(t)}‘i\ s k (t), {«,&, {0'}'%, {r, }£'.,) 

= exp | h (/) - afskit - r / )e- ,e, | 2 dt| 

= n K ‘ ex P [- 2^ J ri S+ ' \~ R 1 (0 - - *i y e ‘ I 2 dt\ (7.4) 

5 Each integral in (7.3) is, in fact, an L^-fold integral. 
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where A - / is an integration constant. Substituting (7.2) into (7.4) and simplifying 
yields 

KfaWjf'rMo. {«;}f=i> mti, fr/ifei) 

= ^jl cx p [ Rc {^"" ,Sw(T,) } ” 

^exp P-5, 

where 

yu in ) = J^' (*)S* {t-n)dt = j* s r, (t + T/ )S£ (r) dt (7.6) 

is the complex cross-correlation of the /th received signal and the kth signal 
waveform and 

Ek = \ J*' |5 fc (t)| 2 dt= ] - j* S+T ' \S k (f - n)\ 2 dt (7.7) 

is the energy of the kth signal s k (t). Also, the constant K absorbs all the A'/’s as 
well as the factor exp[^^, (1 /2Ni) f \Ri(t)\ 2 dt\, which is independent of k and 
thus has no bearing on the decision. Since the natural logarithm is a monotonic 
function of its argument, we can equivalently maximize (with respect to k ) 

A, = In p({ ri (t)}^\s k (t), {cr/jf'j, {9^, {r,}£,) 

where we have ignored the In A" term since it is independent of k. 6 The first 
bracketed term in the summation of (7.8) requires a complex weight (aie-* 6 ') to 
be applied to the /th cross-correlator output (scaled by the noise PSD A/) and 
the second bracketed term is a bias dependent on the signal energy-to-noise ratio 
in the /th path. For constant envelope signal sets (i.e., E k = E; l = 1,2, ... , M), 
the bias can be omitted from the decision-making process. 

A receiver that implements (7.8) as its decision statistic is illustrated in Fig. 7.1 
and is genetically referred to as a RAKE receiver [4,5] because of its structural 

6 For convenience, in what follows we shall use the notation A k for all decision metrics associated 
with the &th signal regardless of any constants that will be ignored because they do not depend on k. 
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